-- Logs begin at Thu 2022-07-14 16:54:20 UTC, end at Thu 2022-07-14 18:26:19 UTC. -- Jul 14 17:42:25.398180 dv-cinder-849890-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 14 17:42:25.409052 dv-cinder-849890-1-iscsi devstack@n-api.service[114927]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 14 17:42:25.411226 dv-cinder-849890-1-iscsi devstack@n-api.service[114927]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 17:42:25 2022] *** Jul 14 17:42:25.411226 dv-cinder-849890-1-iscsi devstack@n-api.service[114927]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 17:42:25.411226 dv-cinder-849890-1-iscsi devstack@n-api.service[114927]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 17:42:25.411226 dv-cinder-849890-1-iscsi devstack@n-api.service[114927]: nodename: dv-cinder-849890-1-iscsi Jul 14 17:42:25.411226 dv-cinder-849890-1-iscsi devstack@n-api.service[114927]: machine: x86_64 Jul 14 17:42:25.411226 dv-cinder-849890-1-iscsi devstack@n-api.service[114927]: clock source: unix Jul 14 17:42:25.411226 dv-cinder-849890-1-iscsi devstack@n-api.service[114927]: pcre jit disabled Jul 14 17:42:25.411226 dv-cinder-849890-1-iscsi devstack@n-api.service[114927]: detected number of CPU cores: 4 Jul 14 17:42:25.411226 dv-cinder-849890-1-iscsi devstack@n-api.service[114927]: current working directory: / Jul 14 17:42:25.411856 dv-cinder-849890-1-iscsi devstack@n-api.service[114927]: detected binary path: /usr/bin/uwsgi-core Jul 14 17:42:25.411856 dv-cinder-849890-1-iscsi devstack@n-api.service[114927]: your processes number limit is 47680 Jul 14 17:42:25.411856 dv-cinder-849890-1-iscsi devstack@n-api.service[114927]: your memory page size is 4096 bytes Jul 14 17:42:25.411856 dv-cinder-849890-1-iscsi devstack@n-api.service[114927]: detected max file descriptor number: 2048 Jul 14 17:42:25.411856 dv-cinder-849890-1-iscsi devstack@n-api.service[114927]: lock engine: pthread robust mutexes Jul 14 17:42:25.411856 dv-cinder-849890-1-iscsi devstack@n-api.service[114927]: thunder lock: enabled Jul 14 17:42:25.411856 dv-cinder-849890-1-iscsi devstack@n-api.service[114927]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 14 17:42:25.411856 dv-cinder-849890-1-iscsi devstack@n-api.service[114927]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 14 17:42:25.458096 dv-cinder-849890-1-iscsi devstack@n-api.service[114927]: Python main interpreter initialized at 0x55caed6599c0 Jul 14 17:42:25.458096 dv-cinder-849890-1-iscsi devstack@n-api.service[114927]: python threads support enabled Jul 14 17:42:25.458096 dv-cinder-849890-1-iscsi devstack@n-api.service[114927]: your server socket listen backlog is limited to 100 connections Jul 14 17:42:25.458096 dv-cinder-849890-1-iscsi devstack@n-api.service[114927]: your mercy for graceful operations on workers is 90 seconds Jul 14 17:42:25.458512 dv-cinder-849890-1-iscsi devstack@n-api.service[114927]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 17:42:25.458512 dv-cinder-849890-1-iscsi devstack@n-api.service[114927]: *** Operational MODE: preforking *** Jul 14 17:42:25.458818 dv-cinder-849890-1-iscsi devstack@n-api.service[114927]: *** uWSGI is running in multiple interpreter mode *** Jul 14 17:42:25.458818 dv-cinder-849890-1-iscsi devstack@n-api.service[114927]: spawned uWSGI master process (pid: 114927) Jul 14 17:42:25.459040 dv-cinder-849890-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 14 17:42:25.460598 dv-cinder-849890-1-iscsi devstack@n-api.service[114927]: spawned uWSGI worker 1 (pid: 114928, cores: 1) Jul 14 17:42:25.460598 dv-cinder-849890-1-iscsi devstack@n-api.service[114927]: spawned uWSGI worker 2 (pid: 114929, cores: 1) Jul 14 17:42:25.460598 dv-cinder-849890-1-iscsi devstack@n-api.service[114927]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 17:42:26.162012 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 17:42:26.223405 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 17:42:27.304699 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 17:42:27.304699 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: from cryptography.utils import int_from_bytes Jul 14 17:42:27.305316 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 17:42:27.305316 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: from cryptography.utils import int_from_bytes Jul 14 17:42:27.329583 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 17:42:27.329583 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: from cryptography.utils import int_from_bytes Jul 14 17:42:27.330137 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 17:42:27.330137 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: from cryptography.utils import int_from_bytes Jul 14 17:42:29.785720 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 17:42:29.786666 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 17:42:29.786666 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 17:42:29.786923 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 17:42:29.787171 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 17:42:29.787559 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.787672 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 17:42:29.788114 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 17:42:29.788261 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.788440 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.788555 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 17:42:29.788703 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.788801 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 17:42:29.788935 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.789059 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 17:42:29.789238 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.789485 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.789587 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.789828 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.789941 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.790229 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.790380 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.790472 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.790558 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.790816 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.790931 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.791745 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.791883 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849890-1-iscsi {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.792036 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.792184 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.792468 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.792580 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.792699 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.792788 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.793036 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.793191 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.793428 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.793575 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.793711 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849890-1-iscsi {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.793803 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.794016 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.794127 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.794423 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.794538 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.794812 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.794982 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.795168 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.795316 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.795473 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.795601 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.795824 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.796003 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.796257 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.796370 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.796590 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.796828 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.796959 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.797216 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.797377 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.797575 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.797692 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.798006 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.798222 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.798366 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849890-1-iscsi {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.798541 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.798687 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.798819 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.798947 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.799088 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.799205 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.799341 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.799602 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.799867 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.799987 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.800139 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.800268 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.800467 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.800654 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.800811 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849890-1-iscsi {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.800966 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.801154 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.801238 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.801474 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.801704 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.801914 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.802023 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.802109 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.802397 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.802532 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.802694 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.802787 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.802997 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.803092 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.803332 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.803467 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.803673 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.803788 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.803999 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.804118 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.804340 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.804593 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.804802 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.804981 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.805146 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.805328 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.805490 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.805811 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.805996 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.806208 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.806358 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.806521 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.806809 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.807073 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.807270 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.807500 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.807731 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.807908 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.807908 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.808365 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.808365 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.808758 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.808939 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.809131 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.809131 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.809473 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.809651 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.809901 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.810094 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.810290 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.810549 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.810737 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.810913 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.811110 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.811269 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.811461 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.811619 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.811764 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.811956 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.812129 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.812285 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.812441 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.812596 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.812752 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.812925 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.813082 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.813244 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.813399 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.813553 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.813718 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.813870 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.814026 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.814198 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.814341 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.814495 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.814639 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.814802 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.814969 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.815139 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.815327 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.815327 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.815621 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.815770 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.815960 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.815960 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.816275 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.816420 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.816560 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.816707 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.816873 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.817015 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.817156 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.817303 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.817444 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.817584 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.817732 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.817873 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.818012 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.818152 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.818291 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.818441 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.818595 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.818746 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.818894 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.819041 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.819180 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.819320 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.819475 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.819616 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.819764 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.819905 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.820107 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.820258 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.820410 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.820558 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.820709 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.820848 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.820987 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.821140 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.821280 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.821427 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.821567 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.821710 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.821849 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.821997 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.822136 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.822353 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.822504 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.822710 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.822856 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.823010 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.823150 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.823290 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.823430 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.823599 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.823783 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.823958 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.824106 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.824263 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.824403 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.824543 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.824692 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.824848 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.824995 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.825135 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.825283 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.825423 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.825573 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.825724 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.825724 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.826007 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.826007 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.826279 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.826440 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.826581 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.826581 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.826843 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.826843 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.827124 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.827124 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.827396 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.827536 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.827675 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.827815 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.827995 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.828153 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.828307 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.828446 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.828584 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.828723 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.828861 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.829023 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.829163 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.829302 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.829440 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.829579 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.829718 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.829867 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.830026 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.830193 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.830333 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.830480 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.830620 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.830771 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.830910 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.831050 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.831187 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.831327 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.831480 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.831627 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.831768 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.831917 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.832162 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.832303 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.832459 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.832599 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.832738 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.832877 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.833016 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.833154 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.833387 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.833541 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.833681 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.833681 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.833964 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.834106 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.834259 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.834409 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.834550 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.834688 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.834827 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.834976 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.835125 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.835273 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:42:29.835413 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.835413 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.835684 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.835847 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.836028 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.836173 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.836312 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.836451 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.836600 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.836751 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.836897 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.837040 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.837177 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.837316 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.837462 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.837612 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.837751 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.837890 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.838619 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.838761 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.838937 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.839091 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.839233 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.839373 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.839520 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.839667 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.839807 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.840027 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.840187 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.840328 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.840468 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.840607 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.840763 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.840913 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.841053 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.841192 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.841331 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.841479 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.841633 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.841774 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.841914 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.842065 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.842204 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.842345 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.842497 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.842639 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.842778 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.842925 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.843066 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.843205 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.843513 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.843707 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.843851 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.844026 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.844171 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.844324 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.844475 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.844616 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.844763 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.844903 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.845042 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.845190 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.845331 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.845472 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.845612 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.845751 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.845900 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.846050 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.846191 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.846341 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.846496 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.846645 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.846785 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.846935 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.847075 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.847223 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.847369 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.847511 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.847511 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.847811 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.848036 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.848183 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.848333 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.848472 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.848622 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.848762 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.848902 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.849049 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.849197 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.849337 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.849490 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.849631 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.849788 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.849928 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.850075 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.850225 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.850374 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.850514 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.850655 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.850794 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.850933 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.851081 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.851222 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.851368 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.851518 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.851668 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.851811 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.851990 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.852138 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.852277 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.852416 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.852562 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.852712 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.852864 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.853005 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.853144 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.853294 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.853444 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.853743 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.854416 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.854560 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.854700 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.854841 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.854987 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.855137 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.855278 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.855425 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.855565 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.855716 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.855856 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.856159 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.856305 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.856446 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.856586 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.856726 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.856875 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.857032 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.857172 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.857312 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.857451 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.857598 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.857738 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.857898 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.858072 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.858215 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.858354 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.858503 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.858653 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.858794 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.858933 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.859074 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.859213 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.859353 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.859502 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.859643 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.859781 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.859965 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.860113 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.860255 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.860407 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.860550 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.860697 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.860845 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.860993 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.861143 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.861293 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.861434 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.861573 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.861729 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.861869 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.862017 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.862165 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.862315 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.862454 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.862603 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.862751 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.862905 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.863056 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.863198 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.863345 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.863485 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.863642 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.863793 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.864007 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.864155 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.864296 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.864436 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.864575 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.864728 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.864868 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.865015 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.865156 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.865295 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.865450 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.865602 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.865750 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.865890 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.866038 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.866178 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.866335 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.866477 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.866624 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.866765 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.866950 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.867093 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.867253 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.867394 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.867545 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.867687 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.867826 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.867987 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.868146 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.868288 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.868427 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.868567 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.868714 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.868854 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.869004 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.869243 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.869440 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.869628 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.869855 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.870027 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.870195 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.870353 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.870554 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.870714 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.870863 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.871014 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.871163 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.871304 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.871454 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.871608 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.871749 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.871898 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.872131 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.872282 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.872476 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.872633 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.872785 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.872937 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.873078 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.873218 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.873368 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.873518 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.873678 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.873829 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.873970 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.874111 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.874251 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.874392 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.874541 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.874683 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.874823 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.874963 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.875110 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.875251 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.875405 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.875556 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.875736 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.875887 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.876078 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.876222 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.876375 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.876525 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.876693 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.876851 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.877002 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.877145 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.877327 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.877486 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.877639 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.877780 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.877932 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.878081 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.878223 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.878362 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.878540 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.878689 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.878830 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.878985 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.879142 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.879283 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.879443 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.879584 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.879732 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.879883 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.880097 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.880240 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.880379 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.880519 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.880660 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.880813 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.880955 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.881148 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.881304 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.881466 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.881617 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.881759 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.881899 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.882039 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.882181 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.882321 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.882480 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.882622 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.882770 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.882910 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.883057 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.883199 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.883363 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.883512 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.883652 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.883792 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.883967 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.884115 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.884348 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.884491 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.884640 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.884853 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.885003 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.885158 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.885302 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.885453 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.885594 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.885734 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.885873 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.886030 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.886178 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.886334 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.886495 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.886642 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.886788 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.886943 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.887092 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.887245 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.887454 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.887603 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.887758 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.887915 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.888130 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.888278 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.888425 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.888571 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.888736 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.889136 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.889296 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.889457 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.889616 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.889763 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.889924 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.890072 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.890220 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.890374 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.890522 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.890677 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.890833 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.890981 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.891128 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.891282 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.891430 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.891589 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.891750 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.891897 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.892074 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.892226 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.892385 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.892553 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.892703 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.892849 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.892995 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.893142 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.893288 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.893443 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.893602 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.893752 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.893898 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.894045 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.894191 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.894347 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.894494 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.894641 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.894819 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.894988 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.895138 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.895294 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.895452 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.895599 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.895746 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.895901 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.896161 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.896322 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.896480 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.896628 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.896782 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.896930 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.897076 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.897250 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.897415 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.897575 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.897729 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.897902 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.898056 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.898218 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.898367 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.898513 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.898669 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.898825 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.898974 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.899139 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.899287 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.899434 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.899590 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.899737 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.899883 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.900084 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.900250 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.900960 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.901130 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.901280 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.901425 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.901579 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.901736 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.901884 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.902040 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.902199 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.902356 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.902505 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.902664 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.902820 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.902975 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.903124 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.903279 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.903437 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.903584 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.903739 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.903886 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.904059 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.904219 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.904383 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.904531 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.904679 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.904826 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.904972 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.905118 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.905279 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.905435 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.905584 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.905731 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.905889 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.906048 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.906204 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.906352 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.906500 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.906646 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.906793 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.906948 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.907097 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.907242 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.907389 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.907537 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.907684 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.907840 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.908052 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.908210 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.908361 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.908515 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.908663 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.908898 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.909055 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.909202 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.909349 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.909349 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.909629 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.909785 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.909932 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.910090 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.910237 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.910383 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.910540 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.910695 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.910843 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.910989 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.911143 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.911291 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.911446 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.911595 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.911740 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.911896 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.912072 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.912220 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.912384 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.912534 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.912680 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.912827 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.912973 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.913120 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.913277 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.913425 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.913574 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.913721 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.913881 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.914039 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.914188 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.914335 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.914483 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.914638 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.914785 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.914941 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.915088 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.915243 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.915390 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.915546 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.915695 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.915866 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.916237 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.916889 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.917039 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.917194 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.917341 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.917498 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.917646 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.917794 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.917939 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.918093 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.918249 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.918405 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.918564 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.918712 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.918858 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.919005 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.919160 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.919315 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.919462 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.919608 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.919763 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.919911 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.920102 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.920251 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.920397 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.920563 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.920711 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.920857 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.921018 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.921167 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.921315 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.921462 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.921608 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.921764 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.921911 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.922066 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.922216 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.922374 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.922521 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.922685 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.922887 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.923042 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.923188 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.923343 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.923491 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.923647 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.923803 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.924036 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.924190 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.924348 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.924507 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.924668 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.924824 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.924980 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.925129 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.925276 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.925432 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.925580 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.925726 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.925872 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.926018 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.926167 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.926324 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.926490 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.926637 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.926792 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.926938 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.927092 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.927249 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.927405 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.927553 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.927699 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.927846 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.928019 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.928181 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.928331 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.928501 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.928651 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.928798 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.928954 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.929101 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.929247 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.929401 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.929549 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.929694 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.929850 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.929998 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.930152 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.930298 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.930455 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.930601 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.930756 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.930902 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.931056 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.931203 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.931350 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.931497 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.931731 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.931887 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.932109 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.932264 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.932429 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.932578 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.932735 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.932883 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.933029 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.933183 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.933330 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.933486 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.933635 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.933782 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.933935 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.934090 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.934245 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.934412 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.934562 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.934708 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.934855 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.935009 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.935157 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.935311 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.935460 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.935614 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.935774 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.935981 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.936099 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.936099 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.936279 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.936279 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.936436 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.936523 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.936617 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.936699 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.936778 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.936868 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.936949 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.937035 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.937205 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.937295 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.937383 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.937469 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.937556 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.937634 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.937721 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.937945 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.938044 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.938237 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.938405 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.938547 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.938722 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.938894 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.939044 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.939201 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.939348 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.939504 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.939652 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.939800 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.939996 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.940227 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.940384 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.940541 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.940689 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.940836 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.940981 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.941127 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.941288 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.941445 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.941592 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.941745 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.941893 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.942039 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.942184 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.942344 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.942492 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.942680 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.942833 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.943033 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.943195 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.943354 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.943652 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.943813 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.944062 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.944230 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.944389 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.944536 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.944684 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.944830 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.944976 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.945123 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.945279 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.945445 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.945594 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.945740 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.945886 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.946032 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.946193 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.946340 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.946500 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.946648 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.946803 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.946960 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.947107 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.947255 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.947506 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.947506 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.947786 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.948025 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.948182 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.948355 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.948513 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.948662 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.948808 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.948964 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.949119 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.949278 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.949425 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.949593 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.949741 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.949888 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.950034 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.950195 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.950344 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.950492 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.950639 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.950785 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.950931 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.951087 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.951234 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.951381 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.951547 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.951696 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.951852 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.952037 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.952195 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.952351 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.952509 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.952658 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.952813 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.952962 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.953108 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.953264 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.953425 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.953590 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.953757 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.953907 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.954053 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.954209 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.954209 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.954489 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.954646 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.954794 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.954940 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.955086 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.955233 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.955406 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.955565 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.955712 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.955867 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.956051 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.956195 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.956306 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.956391 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.956471 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.956621 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.956719 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.956933 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.957032 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.957244 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.957343 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.957550 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.957640 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.957858 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.957961 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.958207 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.958340 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.958513 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.958602 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.958829 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.958926 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.959142 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.959238 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.959472 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.959569 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.959783 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.959878 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.960143 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.960232 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.960469 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.960571 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.960790 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.960880 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.961109 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.961212 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.961420 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.961515 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.961733 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.961827 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.962039 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.962142 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.962346 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.962443 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.962653 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.962742 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.963473 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.963649 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.963814 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.964039 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.964198 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.964346 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.964494 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.964650 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.964806 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.964964 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.965114 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.965261 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.965409 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.965556 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.965703 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.965875 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.966025 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.966171 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.966318 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.966464 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.966620 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.966767 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.966922 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.967111 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.967260 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.967407 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.967568 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.967727 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.967883 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.968054 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.968204 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.968357 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.968527 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.968676 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.968831 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.968978 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.969153 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.969307 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.969467 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.969616 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.969786 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.969934 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.970079 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.970236 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.970383 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.970530 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.970685 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.970833 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.970980 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.971136 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.971283 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.971437 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.971584 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.971746 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.971893 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.972137 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.972289 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.972436 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.972628 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.972777 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.972923 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.973080 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.973228 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.973383 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.973531 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.973678 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.973850 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.974000 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.974147 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.974302 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.974452 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.974599 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.974755 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.974912 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.975068 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.975217 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.975377 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.975527 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.975693 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.975843 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.976013 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.976164 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.976310 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.976509 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.976602 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.976682 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.976797 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.976998 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.977114 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.977321 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.977420 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.977645 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.977742 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.977982 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.978071 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.978302 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.978625 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.978750 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.979472 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.979575 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.979785 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.979887 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.980131 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.980220 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.980452 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.980540 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.980765 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.980854 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.981081 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.981168 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.981396 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.981491 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.981714 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.981804 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.982025 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.982118 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.982338 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.982441 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.982648 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.982734 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.982961 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.983049 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.983275 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.983382 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.983583 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.983670 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.983896 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.984032 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.984232 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.984402 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.984558 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.984645 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.984884 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.984980 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.985204 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.985291 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.985518 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.985614 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.985829 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.985918 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.986144 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.986232 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.986471 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.986696 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.986853 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.987016 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.987164 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.987320 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.987478 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.987644 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.987793 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.987991 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.988157 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.988307 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.988466 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.988615 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.988762 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.988919 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.989076 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.989225 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.989373 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.989551 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.989707 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.989865 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.990023 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.990173 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.990320 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.990468 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.990624 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.990772 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.990918 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.991066 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.991214 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.991361 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.991589 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.991739 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.991887 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.992074 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.992375 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.992537 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.992703 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.992853 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.993007 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.993156 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.993316 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.993464 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.993620 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.993768 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.993915 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.994073 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.994308 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.994471 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.994631 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.994781 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.994928 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.995075 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.995229 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.995390 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.995548 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.995705 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.995853 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.996048 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.996208 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.996369 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.996518 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.996666 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.996825 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.996973 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.996973 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.997262 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.997410 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.997557 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.997706 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.997852 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.998014 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.998175 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.998321 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.998474 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.998622 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.998776 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.998933 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.999081 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.999228 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.999376 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.999529 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.999678 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:29.999834 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.000014 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.000166 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.000325 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.000475 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.000641 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.000797 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.000945 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.001099 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.001247 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.001394 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.001550 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.001699 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.001847 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.002012 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.002169 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.002316 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.002502 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.002653 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.002801 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.002949 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.003105 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.003260 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.003417 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.003565 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.003712 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.003866 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.004044 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.004190 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.004329 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.004469 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.004619 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.004759 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.004909 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.005054 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.005197 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.005329 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.005467 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.005603 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.005739 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.005895 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.006040 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.006183 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.006321 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.006488 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.006630 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.006826 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.006983 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.007138 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.007287 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.007477 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.007632 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.007791 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.008003 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.008171 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.008329 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.008477 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.008635 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.008791 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.008954 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.009103 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.009251 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.009398 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.009554 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.009702 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.010432 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.010584 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.010740 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.010888 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.011045 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.011195 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.011349 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.011505 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.011653 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.011809 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.011976 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.012141 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.012290 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.012446 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.012594 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.012751 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.012900 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.013081 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.013314 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.013540 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.013712 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.014123 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.014311 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.014482 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.014646 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.014849 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.015019 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.015019 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.015375 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.015539 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.015687 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.015854 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.016114 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.016266 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.016433 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.016591 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.016740 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.016887 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.017081 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.017232 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.017380 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.017527 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.017673 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.017821 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.017991 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.018145 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.018293 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.018442 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.018589 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.018746 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.018913 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.019062 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.019209 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.019364 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.019513 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.019669 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.019817 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.020004 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.020159 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.020308 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.020455 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.020613 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.020771 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.020926 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.021075 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.021222 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.021453 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.021613 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.021761 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.021909 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.022063 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.022212 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.022372 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.022521 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.022669 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.022830 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.023034 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.023187 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.023351 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.023508 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.023656 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.023806 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.024042 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.024207 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.024356 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.024503 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.024650 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.024809 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.024964 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.025125 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.025125 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.025558 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.026218 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.026367 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.026522 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.026680 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.026829 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.026976 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.027123 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.027269 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.027437 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.027586 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.027733 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.027889 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.028106 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.028258 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.028418 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.028567 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.028715 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.028862 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.029009 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.029156 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.029312 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.029478 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.029626 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.029772 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.029926 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.030074 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.030234 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.030389 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.030544 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.030691 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.030838 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.030993 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.031151 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.031309 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.031457 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.031603 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.031757 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.031919 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.032117 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.032264 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.032412 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.032558 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.032718 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.032880 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.033028 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.033176 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.033333 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.033480 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.033636 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.033799 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.033956 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.034103 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.034252 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.034399 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.034568 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.034727 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.034876 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.035023 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.035170 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.035329 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.035486 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.035643 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.035840 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.036038 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.036201 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.036350 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.036507 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.036663 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.036824 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.036973 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.037120 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.037278 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.037437 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.037586 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.037733 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.037880 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.038027 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.038183 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.038332 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.038479 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.038627 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.038784 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.038933 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.039092 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.039259 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.039410 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.039557 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.039703 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.039851 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.040088 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.040224 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.040322 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.040408 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.040489 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.040590 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.040673 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.040753 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.040844 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.040925 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.041004 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.041095 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.041095 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.041720 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.041820 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.041910 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.042140 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.042240 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.042455 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.042546 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.042776 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.042871 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.043104 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.043210 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.043412 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.043502 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.043743 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.043847 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.044087 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.044262 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.044423 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.044582 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.044743 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.044891 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.045051 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.045200 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.045347 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.045495 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.045642 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.045791 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.045948 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.046096 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.046274 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.046430 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.046578 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 17:42:30.046745 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.046895 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.047201 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.047528 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.047847 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.048194 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.048520 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.048843 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.049178 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.049513 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.049830 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.050162 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.050500 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.050858 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.051179 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.051530 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.051864 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.052213 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.052533 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.052849 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:42:30.053097 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 17:42:30.108207 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO dbcounter [None req-7c906ea0-aa04-4e8a-9ef1-44f4c891ccec None None] Registered counter for database nova_api Jul 14 17:42:30.114838 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO dbcounter [None req-20845c2d-f947-4663-8ad6-217113ff7375 None None] Registered counter for database nova_api Jul 14 17:42:30.221757 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG oslo_db.sqlalchemy.engines [None req-7c906ea0-aa04-4e8a-9ef1-44f4c891ccec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114928) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 17:42:30.225869 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG oslo_db.sqlalchemy.engines [None req-20845c2d-f947-4663-8ad6-217113ff7375 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114929) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 17:42:30.228251 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG dbcounter [-] [114928] Writer thread running {{(pid=114928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 17:42:30.232725 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG dbcounter [-] [114929] Writer thread running {{(pid=114929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 17:42:30.285414 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.context [None req-7c906ea0-aa04-4e8a-9ef1-44f4c891ccec None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4eefd466-1950-4d22-9e5e-a86218979b69(cell1) {{(pid=114928) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 17:42:30.289147 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.context [None req-20845c2d-f947-4663-8ad6-217113ff7375 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4eefd466-1950-4d22-9e5e-a86218979b69(cell1) {{(pid=114929) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 17:42:30.289376 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG oslo_concurrency.lockutils [None req-7c906ea0-aa04-4e8a-9ef1-44f4c891ccec None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:42:30.290965 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG oslo_concurrency.lockutils [None req-7c906ea0-aa04-4e8a-9ef1-44f4c891ccec None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:42:30.292324 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG oslo_concurrency.lockutils [None req-7c906ea0-aa04-4e8a-9ef1-44f4c891ccec None None] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:42:30.293560 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG oslo_concurrency.lockutils [None req-20845c2d-f947-4663-8ad6-217113ff7375 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:42:30.294427 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG oslo_concurrency.lockutils [None req-7c906ea0-aa04-4e8a-9ef1-44f4c891ccec None None] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:42:30.295201 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG oslo_concurrency.lockutils [None req-20845c2d-f947-4663-8ad6-217113ff7375 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:42:30.296098 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG oslo_concurrency.lockutils [None req-20845c2d-f947-4663-8ad6-217113ff7375 None None] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:42:30.296443 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO dbcounter [None req-7c906ea0-aa04-4e8a-9ef1-44f4c891ccec None None] Registered counter for database nova_cell0 Jul 14 17:42:30.298216 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG oslo_concurrency.lockutils [None req-20845c2d-f947-4663-8ad6-217113ff7375 None None] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:42:30.300238 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO dbcounter [None req-7c906ea0-aa04-4e8a-9ef1-44f4c891ccec None None] Registered counter for database nova_cell1 Jul 14 17:42:30.300345 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO dbcounter [None req-20845c2d-f947-4663-8ad6-217113ff7375 None None] Registered counter for database nova_cell0 Jul 14 17:42:30.304194 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO dbcounter [None req-20845c2d-f947-4663-8ad6-217113ff7375 None None] Registered counter for database nova_cell1 Jul 14 17:42:30.309087 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG oslo_db.sqlalchemy.engines [None req-7c906ea0-aa04-4e8a-9ef1-44f4c891ccec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114928) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 17:42:30.311269 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG oslo_db.sqlalchemy.engines [None req-7c906ea0-aa04-4e8a-9ef1-44f4c891ccec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114928) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 17:42:30.312531 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG oslo_db.sqlalchemy.engines [None req-20845c2d-f947-4663-8ad6-217113ff7375 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114929) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 17:42:30.313919 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG oslo_db.sqlalchemy.engines [None req-20845c2d-f947-4663-8ad6-217113ff7375 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114929) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 17:42:30.315570 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG dbcounter [-] [114928] Writer thread running {{(pid=114928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 17:42:30.320385 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG dbcounter [-] [114929] Writer thread running {{(pid=114929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 17:42:30.322544 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG dbcounter [-] [114929] Writer thread running {{(pid=114929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 17:42:30.454842 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG dbcounter [-] [114928] Writer thread running {{(pid=114928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 17:42:30.465404 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO dbcounter [None req-7c906ea0-aa04-4e8a-9ef1-44f4c891ccec None None] Registered counter for database nova_cell0 Jul 14 17:42:30.466984 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO dbcounter [None req-20845c2d-f947-4663-8ad6-217113ff7375 None None] Registered counter for database nova_cell0 Jul 14 17:42:30.474508 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG oslo_db.sqlalchemy.engines [None req-7c906ea0-aa04-4e8a-9ef1-44f4c891ccec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114928) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 17:42:30.477922 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG oslo_db.sqlalchemy.engines [None req-20845c2d-f947-4663-8ad6-217113ff7375 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114929) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 17:42:30.479840 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG dbcounter [-] [114928] Writer thread running {{(pid=114928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 17:42:30.483320 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG dbcounter [-] [114929] Writer thread running {{(pid=114929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 17:42:30.825378 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: WARNING keystonemiddleware.auth_token [None req-20845c2d-f947-4663-8ad6-217113ff7375 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 17:42:30.832787 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: WARNING keystonemiddleware.auth_token [None req-20845c2d-f947-4663-8ad6-217113ff7375 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 17:42:30.834028 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: WARNING keystonemiddleware.auth_token [None req-7c906ea0-aa04-4e8a-9ef1-44f4c891ccec None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 17:42:30.841406 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: WARNING keystonemiddleware.auth_token [None req-7c906ea0-aa04-4e8a-9ef1-44f4c891ccec None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 17:42:31.175665 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: WARNING keystonemiddleware.auth_token [None req-20845c2d-f947-4663-8ad6-217113ff7375 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 17:42:31.182270 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: WARNING keystonemiddleware.auth_token [None req-20845c2d-f947-4663-8ad6-217113ff7375 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 17:42:31.187470 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55caed6599c0 pid: 114929 (default app) Jul 14 17:42:31.189344 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: WARNING keystonemiddleware.auth_token [None req-7c906ea0-aa04-4e8a-9ef1-44f4c891ccec None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 17:42:31.189559 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-20845c2d-f947-4663-8ad6-217113ff7375 None None] Calling method '>' {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:42:31.190735 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.requestlog [None req-20845c2d-f947-4663-8ad6-217113ff7375 None None] 10.222.0.64 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001729 Jul 14 17:42:31.191143 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: [pid: 114929|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 788 bytes} [Thu Jul 14 17:42:31 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:42:31.195281 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: WARNING keystonemiddleware.auth_token [None req-7c906ea0-aa04-4e8a-9ef1-44f4c891ccec None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 17:42:31.201186 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55caed6599c0 pid: 114928 (default app) Jul 14 17:43:51.999386 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-20845c2d-f947-4663-8ad6-217113ff7375 None None] Calling method '>' {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:43:52.001017 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.requestlog [None req-20845c2d-f947-4663-8ad6-217113ff7375 None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002079 Jul 14 17:43:52.001405 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: [pid: 114929|app: 0|req: 2/2] 10.222.0.64 () {54 vars in 930 bytes} [Thu Jul 14 17:43:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:43:52.013398 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG dbcounter [-] [114928] Writing DB stats nova_api:SELECT=3 {{(pid=114928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:52.014513 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG dbcounter [-] [114928] Writing DB stats nova_cell0:SELECT=3 {{(pid=114928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:52.015400 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG dbcounter [-] [114928] Writing DB stats nova_cell1:SELECT=3 {{(pid=114928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:52.016512 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG dbcounter [-] [114928] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=114928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:52.908587 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-a37294e0-78e6-40dc-931f-92601d404a5d admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:43:52.938984 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-a37294e0-78e6-40dc-931f-92601d404a5d admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.930873 Jul 14 17:43:52.939719 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 1/3] 10.222.0.64 () {60 vars in 1291 bytes} [Thu Jul 14 17:43:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:43:55.321596 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-20845c2d-f947-4663-8ad6-217113ff7375 None None] Calling method '>' {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:43:55.323290 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.requestlog [None req-20845c2d-f947-4663-8ad6-217113ff7375 None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002362 Jul 14 17:43:55.324143 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: [pid: 114929|app: 0|req: 3/4] 10.222.0.64 () {54 vars in 930 bytes} [Thu Jul 14 17:43:55 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:43:55.876529 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-eeebb02b-c398-4453-aeaf-7f62d6f3220e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 1, "id": "c1", "rxtx_factor": 1.0, "vcpus": 1, "ram": 256, "name": "cirros256", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:43:55.896377 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 17:43:55.896377 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: warnings.warn(msg) Jul 14 17:43:55.937038 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-eeebb02b-c398-4453-aeaf-7f62d6f3220e admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.602629 Jul 14 17:43:55.946169 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 2/5] 10.222.0.64 () {64 vars in 1282 bytes} [Thu Jul 14 17:43:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 17:43:55.953683 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG dbcounter [-] [114929] Writing DB stats nova_api:SELECT=3 {{(pid=114929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:55.954603 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG dbcounter [-] [114929] Writing DB stats nova_cell0:SELECT=3 {{(pid=114929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:55.955567 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG dbcounter [-] [114929] Writing DB stats nova_cell1:SELECT=3 {{(pid=114929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:55.956423 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG dbcounter [-] [114929] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=114929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:56.165337 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-4ce87692-05d5-4b55-bed0-a22f90a6454f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:43:56.167909 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 17:43:56.167909 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: warnings.warn(msg) Jul 14 17:43:56.235392 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.requestlog [None req-4ce87692-05d5-4b55-bed0-a22f90a6454f admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287836 Jul 14 17:43:56.236025 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: [pid: 114929|app: 0|req: 4/6] 10.222.0.64 () {64 vars in 1335 bytes} [Thu Jul 14 17:43:55 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:43:58.644881 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-eeebb02b-c398-4453-aeaf-7f62d6f3220e admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:43:58.646334 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-eeebb02b-c398-4453-aeaf-7f62d6f3220e admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Jul 14 17:43:58.646843 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 3/7] 10.222.0.64 () {54 vars in 930 bytes} [Thu Jul 14 17:43:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 17:43:59.460183 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-3f7ca44c-5210-47d3-a293-2f8024b1a425 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "disk": 5, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d1", "ram": 512, "vcpus": 1}} {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:43:59.480287 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 17:43:59.480287 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: warnings.warn(msg) Jul 14 17:43:59.512233 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.requestlog [None req-3f7ca44c-5210-47d3-a293-2f8024b1a425 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.857452 Jul 14 17:43:59.513689 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: [pid: 114929|app: 0|req: 5/8] 10.222.0.64 () {64 vars in 1282 bytes} [Thu Jul 14 17:43:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 17:43:59.534582 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-e166d5b7-6775-482d-9257-be5efee5396b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:43:59.537975 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 17:43:59.537975 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: warnings.warn(msg) Jul 14 17:43:59.593133 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-e166d5b7-6775-482d-9257-be5efee5396b admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.065636 Jul 14 17:43:59.594048 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 4/9] 10.222.0.64 () {64 vars in 1335 bytes} [Thu Jul 14 17:43:59 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:44:02.162056 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-3f7ca44c-5210-47d3-a293-2f8024b1a425 admin admin] Calling method '>' {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:44:02.163172 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.requestlog [None req-3f7ca44c-5210-47d3-a293-2f8024b1a425 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001627 Jul 14 17:44:02.163604 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: [pid: 114929|app: 0|req: 6/10] 10.222.0.64 () {54 vars in 930 bytes} [Thu Jul 14 17:44:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:44:02.650112 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-4350a010-70f8-4d06-8d33-6809f376d16d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "disk": 10, "vcpus": 1, "name": "ds1G", "id": "d2", "ram": 1024, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:44:02.671585 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-4350a010-70f8-4d06-8d33-6809f376d16d admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.501596 Jul 14 17:44:02.672838 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 5/11] 10.222.0.64 () {64 vars in 1282 bytes} [Thu Jul 14 17:44:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 17:44:02.685546 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-64dcdbca-7705-431f-aa2d-2ce692a10e1c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:44:02.713799 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.requestlog [None req-64dcdbca-7705-431f-aa2d-2ce692a10e1c admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031999 Jul 14 17:44:02.714474 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: [pid: 114929|app: 0|req: 7/12] 10.222.0.64 () {64 vars in 1335 bytes} [Thu Jul 14 17:44:02 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:44:05.239528 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-4350a010-70f8-4d06-8d33-6809f376d16d admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:44:05.241283 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-4350a010-70f8-4d06-8d33-6809f376d16d admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002508 Jul 14 17:44:05.241935 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 6/13] 10.222.0.64 () {54 vars in 930 bytes} [Thu Jul 14 17:44:05 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:44:05.857212 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-a523af3a-22e7-4d2f-87c2-e700ca0396f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "disk": 10, "ram": 2048, "vcpus": 2, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:44:05.902954 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.requestlog [None req-a523af3a-22e7-4d2f-87c2-e700ca0396f8 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.652520 Jul 14 17:44:05.903809 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: [pid: 114929|app: 0|req: 8/14] 10.222.0.64 () {64 vars in 1282 bytes} [Thu Jul 14 17:44:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 17:44:05.928796 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-6f826d1f-6c07-433d-b848-d0a2af8abbeb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:44:05.974107 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-6f826d1f-6c07-433d-b848-d0a2af8abbeb admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.056230 Jul 14 17:44:05.976000 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 7/15] 10.222.0.64 () {64 vars in 1335 bytes} [Thu Jul 14 17:44:05 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:44:08.441044 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-a523af3a-22e7-4d2f-87c2-e700ca0396f8 admin admin] Calling method '>' {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:44:08.442288 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.requestlog [None req-a523af3a-22e7-4d2f-87c2-e700ca0396f8 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001664 Jul 14 17:44:08.442838 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: [pid: 114929|app: 0|req: 9/16] 10.222.0.64 () {54 vars in 930 bytes} [Thu Jul 14 17:44:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:44:09.008256 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-32c94619-2b9a-4e80-9522-46d2724a8ecc admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "swap": 0, "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4"}} {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:44:09.032012 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-32c94619-2b9a-4e80-9522-46d2724a8ecc admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.582167 Jul 14 17:44:09.032626 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 8/17] 10.222.0.64 () {64 vars in 1282 bytes} [Thu Jul 14 17:44:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 17:44:09.046098 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-6f4d454e-4a16-4ca1-957b-fd47e8481926 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:44:09.076973 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.requestlog [None req-6f4d454e-4a16-4ca1-957b-fd47e8481926 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035336 Jul 14 17:44:09.095989 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: [pid: 114929|app: 0|req: 10/18] 10.222.0.64 () {64 vars in 1335 bytes} [Thu Jul 14 17:44:09 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:44:11.574054 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-32c94619-2b9a-4e80-9522-46d2724a8ecc admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:44:11.575178 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-32c94619-2b9a-4e80-9522-46d2724a8ecc admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001579 Jul 14 17:44:11.575675 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 9/19] 10.222.0.64 () {54 vars in 930 bytes} [Thu Jul 14 17:44:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 17:44:12.013509 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-e6f9f97c-fc7d-4c67-9805-437c5276a608 admin admin] Calling method '>' {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:44:12.043547 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.requestlog [None req-e6f9f97c-fc7d-4c67-9805-437c5276a608 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.460746 Jul 14 17:44:12.044270 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: [pid: 114929|app: 0|req: 11/20] 10.222.0.64 () {60 vars in 1291 bytes} [Thu Jul 14 17:44:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:44:14.281036 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-32c94619-2b9a-4e80-9522-46d2724a8ecc admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:44:14.282117 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-32c94619-2b9a-4e80-9522-46d2724a8ecc admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 14 17:44:14.282782 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 10/21] 10.222.0.64 () {54 vars in 930 bytes} [Thu Jul 14 17:44:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:44:14.784079 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-09c94a5a-ebd1-4e25-9cb8-1cdadf2eed25 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 512, "swap": 0, "name": "m1.tiny"}} {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:44:14.809850 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.requestlog [None req-09c94a5a-ebd1-4e25-9cb8-1cdadf2eed25 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.521138 Jul 14 17:44:14.810558 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: [pid: 114929|app: 0|req: 12/22] 10.222.0.64 () {64 vars in 1282 bytes} [Thu Jul 14 17:44:14 2022] POST /compute/v2.1/flavors => generated 402 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 17:44:14.828097 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-e2315df0-f7e7-407d-b333-faaaf0a5d27b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:44:14.862880 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-e2315df0-f7e7-407d-b333-faaaf0a5d27b admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041625 Jul 14 17:44:14.863503 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 11/23] 10.222.0.64 () {64 vars in 1332 bytes} [Thu Jul 14 17:44:14 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:44:17.226969 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-09c94a5a-ebd1-4e25-9cb8-1cdadf2eed25 admin admin] Calling method '>' {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:44:17.228060 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.requestlog [None req-09c94a5a-ebd1-4e25-9cb8-1cdadf2eed25 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jul 14 17:44:17.228514 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: [pid: 114929|app: 0|req: 13/24] 10.222.0.64 () {54 vars in 930 bytes} [Thu Jul 14 17:44:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:44:17.653293 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-e5836d99-a868-478b-b06a-a92394b6650f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "2", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "vcpus": 1}} {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:44:17.677293 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-e5836d99-a868-478b-b06a-a92394b6650f admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.442180 Jul 14 17:44:17.677808 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 12/25] 10.222.0.64 () {64 vars in 1282 bytes} [Thu Jul 14 17:44:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 17:44:17.693097 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-44af9052-01af-4260-9548-eb2cd3d817a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:44:17.725613 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.requestlog [None req-44af9052-01af-4260-9548-eb2cd3d817a6 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036166 Jul 14 17:44:17.726198 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: [pid: 114929|app: 0|req: 14/26] 10.222.0.64 () {64 vars in 1332 bytes} [Thu Jul 14 17:44:17 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:44:20.052658 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-e5836d99-a868-478b-b06a-a92394b6650f admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:44:20.053678 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-e5836d99-a868-478b-b06a-a92394b6650f admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jul 14 17:44:20.054083 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 13/27] 10.222.0.64 () {54 vars in 930 bytes} [Thu Jul 14 17:44:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:44:20.503917 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-6e656baf-9f57-4df5-a129-5254e63e4d07 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "name": "m1.medium", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "disk": 40, "ram": 4096, "swap": 0}} {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:44:20.525387 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.requestlog [None req-6e656baf-9f57-4df5-a129-5254e63e4d07 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.464815 Jul 14 17:44:20.525927 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: [pid: 114929|app: 0|req: 15/28] 10.222.0.64 () {64 vars in 1282 bytes} [Thu Jul 14 17:44:20 2022] POST /compute/v2.1/flavors => generated 406 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 17:44:20.541298 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-e2a6b5b7-8964-4c06-9e91-24fd946c3d11 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:44:20.569135 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-e2a6b5b7-8964-4c06-9e91-24fd946c3d11 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034873 Jul 14 17:44:20.570063 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 14/29] 10.222.0.64 () {64 vars in 1332 bytes} [Thu Jul 14 17:44:20 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:44:22.969451 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-6e656baf-9f57-4df5-a129-5254e63e4d07 admin admin] Calling method '>' {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:44:22.971032 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.requestlog [None req-6e656baf-9f57-4df5-a129-5254e63e4d07 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jul 14 17:44:22.971438 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: [pid: 114929|app: 0|req: 16/30] 10.222.0.64 () {54 vars in 930 bytes} [Thu Jul 14 17:44:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:44:23.550166 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-beb80b03-9204-4a40-a702-a1c7f930f469 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "os-flavor-access:is_public": true, "id": "4", "swap": 0, "disk": 80, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "name": "m1.large"}} {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:44:23.557656 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG dbcounter [-] [114928] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=114928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:44:23.573479 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-beb80b03-9204-4a40-a702-a1c7f930f469 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.595654 Jul 14 17:44:23.574134 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 15/31] 10.222.0.64 () {64 vars in 1282 bytes} [Thu Jul 14 17:44:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 17:44:23.586442 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-28b1d7a5-0bfb-4198-ab01-12981d0b4a69 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:44:23.613849 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.requestlog [None req-28b1d7a5-0bfb-4198-ab01-12981d0b4a69 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031003 Jul 14 17:44:23.614436 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: [pid: 114929|app: 0|req: 17/32] 10.222.0.64 () {64 vars in 1332 bytes} [Thu Jul 14 17:44:23 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:44:26.514232 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-beb80b03-9204-4a40-a702-a1c7f930f469 admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:44:26.515952 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-beb80b03-9204-4a40-a702-a1c7f930f469 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002398 Jul 14 17:44:26.520314 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 16/33] 10.222.0.64 () {54 vars in 930 bytes} [Thu Jul 14 17:44:26 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:44:27.022598 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-d4c27bae-3253-45e7-b5b6-121e9b5868d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 8, "ram": 16384, "name": "m1.xlarge", "id": "5", "rxtx_factor": 1.0}} {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:44:27.032340 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG dbcounter [-] [114929] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=114929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:44:27.045969 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.requestlog [None req-d4c27bae-3253-45e7-b5b6-121e9b5868d7 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.519786 Jul 14 17:44:27.047451 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: [pid: 114929|app: 0|req: 18/34] 10.222.0.64 () {64 vars in 1282 bytes} [Thu Jul 14 17:44:26 2022] POST /compute/v2.1/flavors => generated 408 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 17:44:27.059863 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-f7169bdb-ff6e-49c1-bb65-2c738755a53c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:44:27.088166 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-f7169bdb-ff6e-49c1-bb65-2c738755a53c admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031989 Jul 14 17:44:27.089034 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 17/35] 10.222.0.64 () {64 vars in 1332 bytes} [Thu Jul 14 17:44:27 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:44:46.255692 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-d4c27bae-3253-45e7-b5b6-121e9b5868d7 admin admin] Calling method '>' {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:44:46.256765 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.requestlog [None req-d4c27bae-3253-45e7-b5b6-121e9b5868d7 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Jul 14 17:44:46.257167 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: [pid: 114929|app: 0|req: 19/36] 10.222.0.64 () {54 vars in 930 bytes} [Thu Jul 14 17:44:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:44:46.267654 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG dbcounter [-] [114928] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=114928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:44:46.668789 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-66824356-bf40-4539-a445-a97cc9b02055 admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:44:46.686509 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-66824356-bf40-4539-a445-a97cc9b02055 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.423102 Jul 14 17:44:46.686970 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 18/37] 10.222.0.64 () {60 vars in 1291 bytes} [Thu Jul 14 17:44:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:44:47.775732 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-d4c27bae-3253-45e7-b5b6-121e9b5868d7 admin admin] Calling method '>' {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:44:47.776777 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.requestlog [None req-d4c27bae-3253-45e7-b5b6-121e9b5868d7 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001744 Jul 14 17:44:47.777165 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: [pid: 114929|app: 0|req: 20/38] 10.222.0.64 () {56 vars in 1074 bytes} [Thu Jul 14 17:44:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:44:48.315073 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-69aca80b-c031-4917-8b77-17d0d66f05e0 admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:44:48.320730 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.wsgi [None req-69aca80b-c031-4917-8b77-17d0d66f05e0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 14 17:44:48.324113 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-69aca80b-c031-4917-8b77-17d0d66f05e0 admin admin] Request method failure captured: Jul 14 17:44:48.324113 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 14 17:44:48.324113 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: Accept: application/json Jul 14 17:44:48.324113 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: Accept-Encoding: gzip, deflate Jul 14 17:44:48.324113 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: Connection: keep-alive Jul 14 17:44:48.324113 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: Content-Length: 0 Jul 14 17:44:48.324113 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: Host: 10.222.0.64 Jul 14 17:44:48.324113 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: Openstack-Api-Version: compute 2.90 Jul 14 17:44:48.324113 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: Openstack-System-Scope: None Jul 14 17:44:48.324113 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: User-Agent: python-novaclient Jul 14 17:44:48.324113 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Auth-Token: gAAAAABi0FYPjM4Z-rVhwV7IXpFkkrsBNFiv7rwll9lqfV2NWY0M17pGnYTg1zUa98h8swLcMIxTr4to4wLiC3ctCb10ZusyNxkFlP8fyDnmuJiNjByw5ZIuba9n0ktdqGT04YDOFFI9X0_Vr39FkyS_ME5hTciSsh1WGtTWt03LOpapr6_bvF0 Jul 14 17:44:48.324113 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Domain-Id: None Jul 14 17:44:48.324113 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Domain-Name: None Jul 14 17:44:48.324113 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Identity-Status: Confirmed Jul 14 17:44:48.324113 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Is-Admin-Project: True Jul 14 17:44:48.324113 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 17:44:48.324113 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Project-Domain-Id: default Jul 14 17:44:48.324113 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Project-Domain-Name: Default Jul 14 17:44:48.324113 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Project-Id: 29b8bf26bc324367a4fe27e90fc2d6df Jul 14 17:44:48.324113 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Project-Name: admin Jul 14 17:44:48.324113 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Role: admin,reader,member Jul 14 17:44:48.324113 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Roles: admin,reader,member Jul 14 17:44:48.325775 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/29b8bf26bc324367a4fe27e90fc2d6df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/29b8bf26bc324367a4fe27e90fc2d6df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/29b8bf26bc324367a4fe27e90fc2d6df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_29b8bf26bc324367a4fe27e90fc2d6df", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 17:44:48.325775 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Tenant: admin Jul 14 17:44:48.325775 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Tenant-Id: 29b8bf26bc324367a4fe27e90fc2d6df Jul 14 17:44:48.325775 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Tenant-Name: admin Jul 14 17:44:48.325775 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-User: admin Jul 14 17:44:48.325775 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-User-Domain-Id: default Jul 14 17:44:48.325775 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-User-Domain-Name: Default Jul 14 17:44:48.325775 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-User-Id: 7d77dedfd6bd435d94f994cfcde5100a Jul 14 17:44:48.325775 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-User-Name: admin Jul 14 17:44:48.325775 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: method: > Jul 14 17:44:48.325775 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: exception: Flavor 42 could not be found. Jul 14 17:44:48.325775 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: action_args: {'id': '42'} Jul 14 17:44:48.325775 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 17:44:48.325775 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:44:48.326747 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 17:44:48.326747 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 17:44:48.326747 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 17:44:48.326747 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 17:44:48.326747 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 17:44:48.326747 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 17:44:48.326747 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 17:44:48.326747 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 17:44:48.326747 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 17:44:48.326747 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 17:44:48.326747 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 17:44:48.326747 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 17:44:48.326747 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 14 17:44:48.326747 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Jul 14 17:44:48.326747 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:44:48.326747 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Jul 14 17:44:48.326747 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:44:48.326747 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:44:48.326747 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:44:48.328110 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 17:44:48.328110 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 17:44:48.328110 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 17:44:48.328110 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 17:44:48.328110 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 17:44:48.328110 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 17:44:48.328110 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 14 17:44:48.328110 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Jul 14 17:44:48.328110 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:44:48.328110 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Jul 14 17:44:48.328110 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:44:48.328110 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:44:48.328110 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:44:48.328110 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 17:44:48.328110 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 17:44:48.328110 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 14 17:44:48.328110 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Jul 14 17:44:48.328110 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-69aca80b-c031-4917-8b77-17d0d66f05e0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 17:44:48.329364 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-69aca80b-c031-4917-8b77-17d0d66f05e0 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.409568 Jul 14 17:44:48.329364 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 19/39] 10.222.0.64 () {60 vars in 1190 bytes} [Thu Jul 14 17:44:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 411 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 17:44:48.336399 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-ca2d1b69-a4dc-4b96-953c-a0ab40d03152 admin admin] Calling method '>' {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:44:48.359901 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.requestlog [None req-ca2d1b69-a4dc-4b96-953c-a0ab40d03152 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027570 Jul 14 17:44:48.360493 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: [pid: 114929|app: 0|req: 21/40] 10.222.0.64 () {60 vars in 1210 bytes} [Thu Jul 14 17:44:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:44:48.370425 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-d1b28134-cc12-4fd3-b312-3903dc59dcba admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:44:48.392879 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-d1b28134-cc12-4fd3-b312-3903dc59dcba admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025976 Jul 14 17:44:48.393447 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 20/41] 10.222.0.64 () {60 vars in 1210 bytes} [Thu Jul 14 17:44:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:44:48.411005 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-b14dc2a1-3a3b-491d-80f2-ac4a056e8ac4 admin admin] Calling method '>' {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:44:48.417017 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.wsgi [None req-b14dc2a1-3a3b-491d-80f2-ac4a056e8ac4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 14 17:44:48.420452 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-b14dc2a1-3a3b-491d-80f2-ac4a056e8ac4 admin admin] Request method failure captured: Jul 14 17:44:48.420452 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 14 17:44:48.420452 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: Accept: application/json Jul 14 17:44:48.420452 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: Accept-Encoding: gzip, deflate Jul 14 17:44:48.420452 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: Connection: keep-alive Jul 14 17:44:48.420452 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: Content-Length: 0 Jul 14 17:44:48.420452 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: Host: 10.222.0.64 Jul 14 17:44:48.420452 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: Openstack-Api-Version: compute 2.90 Jul 14 17:44:48.420452 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: Openstack-System-Scope: None Jul 14 17:44:48.420452 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: User-Agent: python-novaclient Jul 14 17:44:48.420452 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Auth-Token: gAAAAABi0FYPjM4Z-rVhwV7IXpFkkrsBNFiv7rwll9lqfV2NWY0M17pGnYTg1zUa98h8swLcMIxTr4to4wLiC3ctCb10ZusyNxkFlP8fyDnmuJiNjByw5ZIuba9n0ktdqGT04YDOFFI9X0_Vr39FkyS_ME5hTciSsh1WGtTWt03LOpapr6_bvF0 Jul 14 17:44:48.420452 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Domain-Id: None Jul 14 17:44:48.420452 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Domain-Name: None Jul 14 17:44:48.420452 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Identity-Status: Confirmed Jul 14 17:44:48.420452 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Is-Admin-Project: True Jul 14 17:44:48.420452 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 17:44:48.420452 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Project-Domain-Id: default Jul 14 17:44:48.420452 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Project-Domain-Name: Default Jul 14 17:44:48.420452 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Project-Id: 29b8bf26bc324367a4fe27e90fc2d6df Jul 14 17:44:48.420452 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Project-Name: admin Jul 14 17:44:48.420452 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Role: admin,reader,member Jul 14 17:44:48.420452 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Roles: admin,reader,member Jul 14 17:44:48.422090 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/29b8bf26bc324367a4fe27e90fc2d6df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/29b8bf26bc324367a4fe27e90fc2d6df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/29b8bf26bc324367a4fe27e90fc2d6df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_29b8bf26bc324367a4fe27e90fc2d6df", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 17:44:48.422090 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Tenant: admin Jul 14 17:44:48.422090 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Tenant-Id: 29b8bf26bc324367a4fe27e90fc2d6df Jul 14 17:44:48.422090 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Tenant-Name: admin Jul 14 17:44:48.422090 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-User: admin Jul 14 17:44:48.422090 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-User-Domain-Id: default Jul 14 17:44:48.422090 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-User-Domain-Name: Default Jul 14 17:44:48.422090 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-User-Id: 7d77dedfd6bd435d94f994cfcde5100a Jul 14 17:44:48.422090 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-User-Name: admin Jul 14 17:44:48.422090 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: method: > Jul 14 17:44:48.422090 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: exception: Flavor 42 could not be found. Jul 14 17:44:48.422090 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: action_args: {'id': '42'} Jul 14 17:44:48.422090 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 17:44:48.422090 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:44:48.423062 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 17:44:48.423062 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 17:44:48.423062 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 17:44:48.423062 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 17:44:48.423062 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 17:44:48.423062 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 17:44:48.423062 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 17:44:48.423062 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 17:44:48.423062 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 17:44:48.423062 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 17:44:48.423062 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 17:44:48.423062 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 17:44:48.423062 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 14 17:44:48.423062 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi Jul 14 17:44:48.423062 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:44:48.423062 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi Jul 14 17:44:48.423062 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:44:48.423062 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:44:48.423062 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:44:48.424687 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 17:44:48.424687 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 17:44:48.424687 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 17:44:48.424687 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 17:44:48.424687 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 17:44:48.424687 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 17:44:48.424687 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 14 17:44:48.424687 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi Jul 14 17:44:48.424687 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:44:48.424687 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi Jul 14 17:44:48.424687 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:44:48.424687 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:44:48.424687 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:44:48.424687 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 17:44:48.424687 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 17:44:48.424687 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 14 17:44:48.424687 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi Jul 14 17:44:48.424687 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-b14dc2a1-3a3b-491d-80f2-ac4a056e8ac4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 17:44:48.426065 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.requestlog [None req-b14dc2a1-3a3b-491d-80f2-ac4a056e8ac4 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.021799 Jul 14 17:44:48.426065 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: [pid: 114929|app: 0|req: 22/42] 10.222.0.64 () {60 vars in 1190 bytes} [Thu Jul 14 17:44:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 14 17:44:49.410429 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-d1b28134-cc12-4fd3-b312-3903dc59dcba admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:44:49.411450 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-d1b28134-cc12-4fd3-b312-3903dc59dcba admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002058 Jul 14 17:44:49.411849 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 21/43] 10.222.0.64 () {56 vars in 1074 bytes} [Thu Jul 14 17:44:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:44:49.954416 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-e8d49cf9-2b77-4fde-ad97-deac16cef652 admin admin] Calling method '>' {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:44:49.961217 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.wsgi [None req-e8d49cf9-2b77-4fde-ad97-deac16cef652 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 14 17:44:49.962746 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-e8d49cf9-2b77-4fde-ad97-deac16cef652 admin admin] Request method failure captured: Jul 14 17:44:49.962746 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 14 17:44:49.962746 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: Accept: application/json Jul 14 17:44:49.962746 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: Accept-Encoding: gzip, deflate Jul 14 17:44:49.962746 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: Connection: keep-alive Jul 14 17:44:49.962746 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: Content-Length: 0 Jul 14 17:44:49.962746 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: Host: 10.222.0.64 Jul 14 17:44:49.962746 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: Openstack-Api-Version: compute 2.90 Jul 14 17:44:49.962746 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: Openstack-System-Scope: None Jul 14 17:44:49.962746 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: User-Agent: python-novaclient Jul 14 17:44:49.962746 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Auth-Token: gAAAAABi0FYRUaAjSxPbrFhwJRqHiD3qRbbg6-mAKcOuLRJLKZvvXNCWgsZtg3DolKjBDv69cdp8pY7SxrOpkseN-de6c7l_2hTCSrmv2sH5DLahguZ8KP0aXjSffygjFpHvrzvHPjHbYEfDmeaixSzcvziKt9g-qXJziQeCnQTEI6DQOe4St2o Jul 14 17:44:49.962746 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Domain-Id: None Jul 14 17:44:49.962746 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Domain-Name: None Jul 14 17:44:49.962746 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Identity-Status: Confirmed Jul 14 17:44:49.962746 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Is-Admin-Project: True Jul 14 17:44:49.962746 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 17:44:49.962746 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Project-Domain-Id: default Jul 14 17:44:49.962746 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Project-Domain-Name: Default Jul 14 17:44:49.962746 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Project-Id: 29b8bf26bc324367a4fe27e90fc2d6df Jul 14 17:44:49.962746 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Project-Name: admin Jul 14 17:44:49.962746 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Role: admin,reader,member Jul 14 17:44:49.962746 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Roles: admin,reader,member Jul 14 17:44:49.964362 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/29b8bf26bc324367a4fe27e90fc2d6df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/29b8bf26bc324367a4fe27e90fc2d6df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/29b8bf26bc324367a4fe27e90fc2d6df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_29b8bf26bc324367a4fe27e90fc2d6df", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 17:44:49.964362 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Tenant: admin Jul 14 17:44:49.964362 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Tenant-Id: 29b8bf26bc324367a4fe27e90fc2d6df Jul 14 17:44:49.964362 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Tenant-Name: admin Jul 14 17:44:49.964362 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-User: admin Jul 14 17:44:49.964362 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-User-Domain-Id: default Jul 14 17:44:49.964362 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-User-Domain-Name: Default Jul 14 17:44:49.964362 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-User-Id: 7d77dedfd6bd435d94f994cfcde5100a Jul 14 17:44:49.964362 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-User-Name: admin Jul 14 17:44:49.964362 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: method: > Jul 14 17:44:49.964362 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: exception: Flavor 84 could not be found. Jul 14 17:44:49.964362 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: action_args: {'id': '84'} Jul 14 17:44:49.964362 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 17:44:49.964362 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:44:49.965349 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 17:44:49.965349 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 17:44:49.965349 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 17:44:49.965349 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 17:44:49.965349 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 17:44:49.965349 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 17:44:49.965349 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 17:44:49.965349 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 17:44:49.965349 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 17:44:49.965349 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 17:44:49.965349 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 17:44:49.965349 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 17:44:49.965349 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 14 17:44:49.965349 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi Jul 14 17:44:49.965349 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:44:49.965349 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi Jul 14 17:44:49.965349 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:44:49.965349 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:44:49.965349 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:44:49.966767 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 17:44:49.966767 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 17:44:49.966767 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 17:44:49.966767 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 17:44:49.966767 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 17:44:49.966767 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 17:44:49.966767 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 14 17:44:49.966767 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi Jul 14 17:44:49.966767 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:44:49.966767 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi Jul 14 17:44:49.966767 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:44:49.966767 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:44:49.966767 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:44:49.966767 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 17:44:49.966767 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 17:44:49.966767 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 14 17:44:49.966767 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi Jul 14 17:44:49.966767 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-e8d49cf9-2b77-4fde-ad97-deac16cef652 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 17:44:49.968092 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.requestlog [None req-e8d49cf9-2b77-4fde-ad97-deac16cef652 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.413564 Jul 14 17:44:49.968092 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: [pid: 114929|app: 0|req: 23/44] 10.222.0.64 () {60 vars in 1190 bytes} [Thu Jul 14 17:44:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 415 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 17:44:49.973906 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-b882f896-36d5-4052-b3c3-77c8cf36cc89 admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:44:49.987266 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-b882f896-36d5-4052-b3c3-77c8cf36cc89 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016975 Jul 14 17:44:49.987832 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 22/45] 10.222.0.64 () {60 vars in 1210 bytes} [Thu Jul 14 17:44:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:44:49.997149 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-a6bf51a0-6024-481a-ab77-54edf3559e32 admin admin] Calling method '>' {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:44:50.011316 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.requestlog [None req-a6bf51a0-6024-481a-ab77-54edf3559e32 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017673 Jul 14 17:44:50.011843 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: [pid: 114929|app: 0|req: 24/46] 10.222.0.64 () {60 vars in 1210 bytes} [Thu Jul 14 17:44:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:44:50.021784 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-6b2219bc-4ba5-4992-896b-62006c6fe545 admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:44:50.027423 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.wsgi [None req-6b2219bc-4ba5-4992-896b-62006c6fe545 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 14 17:44:50.028968 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-6b2219bc-4ba5-4992-896b-62006c6fe545 admin admin] Request method failure captured: Jul 14 17:44:50.028968 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 14 17:44:50.028968 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: Accept: application/json Jul 14 17:44:50.028968 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: Accept-Encoding: gzip, deflate Jul 14 17:44:50.028968 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: Connection: keep-alive Jul 14 17:44:50.028968 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: Content-Length: 0 Jul 14 17:44:50.028968 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: Host: 10.222.0.64 Jul 14 17:44:50.028968 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: Openstack-Api-Version: compute 2.90 Jul 14 17:44:50.028968 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: Openstack-System-Scope: None Jul 14 17:44:50.028968 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: User-Agent: python-novaclient Jul 14 17:44:50.028968 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Auth-Token: gAAAAABi0FYRUaAjSxPbrFhwJRqHiD3qRbbg6-mAKcOuLRJLKZvvXNCWgsZtg3DolKjBDv69cdp8pY7SxrOpkseN-de6c7l_2hTCSrmv2sH5DLahguZ8KP0aXjSffygjFpHvrzvHPjHbYEfDmeaixSzcvziKt9g-qXJziQeCnQTEI6DQOe4St2o Jul 14 17:44:50.028968 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Domain-Id: None Jul 14 17:44:50.028968 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Domain-Name: None Jul 14 17:44:50.028968 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Identity-Status: Confirmed Jul 14 17:44:50.028968 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Is-Admin-Project: True Jul 14 17:44:50.028968 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 17:44:50.028968 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Project-Domain-Id: default Jul 14 17:44:50.028968 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Project-Domain-Name: Default Jul 14 17:44:50.028968 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Project-Id: 29b8bf26bc324367a4fe27e90fc2d6df Jul 14 17:44:50.028968 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Project-Name: admin Jul 14 17:44:50.028968 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Role: admin,reader,member Jul 14 17:44:50.028968 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Roles: admin,reader,member Jul 14 17:44:50.030491 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/29b8bf26bc324367a4fe27e90fc2d6df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/29b8bf26bc324367a4fe27e90fc2d6df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/29b8bf26bc324367a4fe27e90fc2d6df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_29b8bf26bc324367a4fe27e90fc2d6df", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 17:44:50.030491 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Tenant: admin Jul 14 17:44:50.030491 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Tenant-Id: 29b8bf26bc324367a4fe27e90fc2d6df Jul 14 17:44:50.030491 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Tenant-Name: admin Jul 14 17:44:50.030491 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-User: admin Jul 14 17:44:50.030491 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-User-Domain-Id: default Jul 14 17:44:50.030491 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-User-Domain-Name: Default Jul 14 17:44:50.030491 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-User-Id: 7d77dedfd6bd435d94f994cfcde5100a Jul 14 17:44:50.030491 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-User-Name: admin Jul 14 17:44:50.030491 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: method: > Jul 14 17:44:50.030491 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: exception: Flavor 84 could not be found. Jul 14 17:44:50.030491 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: action_args: {'id': '84'} Jul 14 17:44:50.030491 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 17:44:50.030491 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:44:50.031454 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 17:44:50.031454 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 17:44:50.031454 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 17:44:50.031454 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 17:44:50.031454 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 17:44:50.031454 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 17:44:50.031454 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 17:44:50.031454 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 17:44:50.031454 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 17:44:50.031454 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 17:44:50.031454 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 17:44:50.031454 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 17:44:50.031454 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 14 17:44:50.031454 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Jul 14 17:44:50.031454 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:44:50.031454 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Jul 14 17:44:50.031454 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:44:50.031454 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:44:50.031454 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:44:50.032948 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 17:44:50.032948 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 17:44:50.032948 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 17:44:50.032948 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 17:44:50.032948 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 17:44:50.032948 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 17:44:50.032948 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 14 17:44:50.032948 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Jul 14 17:44:50.032948 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:44:50.032948 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Jul 14 17:44:50.032948 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:44:50.032948 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:44:50.032948 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:44:50.032948 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 17:44:50.032948 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 17:44:50.032948 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 14 17:44:50.032948 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Jul 14 17:44:50.032948 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-6b2219bc-4ba5-4992-896b-62006c6fe545 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 17:44:50.034225 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-6b2219bc-4ba5-4992-896b-62006c6fe545 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012699 Jul 14 17:44:50.034225 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 23/47] 10.222.0.64 () {60 vars in 1190 bytes} [Thu Jul 14 17:44:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 17:44:51.024467 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-a6bf51a0-6024-481a-ab77-54edf3559e32 admin admin] Calling method '>' {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:44:51.025880 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.requestlog [None req-a6bf51a0-6024-481a-ab77-54edf3559e32 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001825 Jul 14 17:44:51.026394 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: [pid: 114929|app: 0|req: 25/48] 10.222.0.64 () {56 vars in 1074 bytes} [Thu Jul 14 17:44:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 17:44:51.580247 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-bcc4acfe-7a90-486e-aba4-c3dc7f6d9494 admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:44:51.586461 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.wsgi [None req-bcc4acfe-7a90-486e-aba4-c3dc7f6d9494 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 14 17:44:51.587983 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-bcc4acfe-7a90-486e-aba4-c3dc7f6d9494 admin admin] Request method failure captured: Jul 14 17:44:51.587983 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 14 17:44:51.587983 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: Accept: application/json Jul 14 17:44:51.587983 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: Accept-Encoding: gzip, deflate Jul 14 17:44:51.587983 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: Connection: keep-alive Jul 14 17:44:51.587983 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: Content-Length: 0 Jul 14 17:44:51.587983 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: Host: 10.222.0.64 Jul 14 17:44:51.587983 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: Openstack-Api-Version: compute 2.90 Jul 14 17:44:51.587983 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: Openstack-System-Scope: None Jul 14 17:44:51.587983 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: User-Agent: python-novaclient Jul 14 17:44:51.587983 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Auth-Token: gAAAAABi0FYSOLv1HbQEYkg-5XePDPJmZe1ieZNsJC4wrq2OjzrC_mMclLjBzM3jbyz54kBQszykIlfjdJFhVoo4mPNph4a-uFhLNtYqvfWSl6L9JY6uIygFRA3t70hbBckMPShdkyWdqAjdbkZPjHadqJ_l1V-48O2Btkqiv-ClWXYZuieJSEQ Jul 14 17:44:51.587983 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Domain-Id: None Jul 14 17:44:51.587983 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Domain-Name: None Jul 14 17:44:51.587983 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Identity-Status: Confirmed Jul 14 17:44:51.587983 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Is-Admin-Project: True Jul 14 17:44:51.587983 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 17:44:51.587983 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Project-Domain-Id: default Jul 14 17:44:51.587983 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Project-Domain-Name: Default Jul 14 17:44:51.587983 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Project-Id: 29b8bf26bc324367a4fe27e90fc2d6df Jul 14 17:44:51.587983 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Project-Name: admin Jul 14 17:44:51.587983 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Role: admin,reader,member Jul 14 17:44:51.587983 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Roles: admin,reader,member Jul 14 17:44:51.589633 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/29b8bf26bc324367a4fe27e90fc2d6df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/29b8bf26bc324367a4fe27e90fc2d6df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/29b8bf26bc324367a4fe27e90fc2d6df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_29b8bf26bc324367a4fe27e90fc2d6df", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 17:44:51.589633 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Tenant: admin Jul 14 17:44:51.589633 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Tenant-Id: 29b8bf26bc324367a4fe27e90fc2d6df Jul 14 17:44:51.589633 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-Tenant-Name: admin Jul 14 17:44:51.589633 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-User: admin Jul 14 17:44:51.589633 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-User-Domain-Id: default Jul 14 17:44:51.589633 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-User-Domain-Name: Default Jul 14 17:44:51.589633 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-User-Id: 7d77dedfd6bd435d94f994cfcde5100a Jul 14 17:44:51.589633 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: X-User-Name: admin Jul 14 17:44:51.589633 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: method: > Jul 14 17:44:51.589633 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: exception: Flavor 451 could not be found. Jul 14 17:44:51.589633 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: action_args: {'id': '451'} Jul 14 17:44:51.589633 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 17:44:51.589633 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:44:51.590604 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 17:44:51.590604 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 17:44:51.590604 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 17:44:51.590604 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 17:44:51.590604 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 17:44:51.590604 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 17:44:51.590604 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 17:44:51.590604 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 17:44:51.590604 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 17:44:51.590604 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 17:44:51.590604 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 17:44:51.590604 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 17:44:51.590604 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 14 17:44:51.590604 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Jul 14 17:44:51.590604 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:44:51.590604 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Jul 14 17:44:51.590604 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:44:51.590604 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:44:51.590604 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:44:51.592261 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 17:44:51.592261 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 17:44:51.592261 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 17:44:51.592261 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 17:44:51.592261 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 17:44:51.592261 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 17:44:51.592261 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 14 17:44:51.592261 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Jul 14 17:44:51.592261 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:44:51.592261 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Jul 14 17:44:51.592261 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:44:51.592261 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:44:51.592261 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:44:51.592261 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 17:44:51.592261 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 17:44:51.592261 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 14 17:44:51.592261 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Jul 14 17:44:51.592261 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-bcc4acfe-7a90-486e-aba4-c3dc7f6d9494 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 17:44:51.593521 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-bcc4acfe-7a90-486e-aba4-c3dc7f6d9494 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.425698 Jul 14 17:44:51.593521 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 24/49] 10.222.0.64 () {60 vars in 1193 bytes} [Thu Jul 14 17:44:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 427 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 17:44:51.599075 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-5f2b522a-ec9f-4d16-a054-929382d5e670 admin admin] Calling method '>' {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:44:51.612373 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.requestlog [None req-5f2b522a-ec9f-4d16-a054-929382d5e670 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017013 Jul 14 17:44:51.612919 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: [pid: 114929|app: 0|req: 26/50] 10.222.0.64 () {60 vars in 1210 bytes} [Thu Jul 14 17:44:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:44:51.622218 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-0d5d0862-e0af-45e8-990a-36b8b55534db admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:44:51.637564 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-0d5d0862-e0af-45e8-990a-36b8b55534db admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018771 Jul 14 17:44:51.638114 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 25/51] 10.222.0.64 () {60 vars in 1210 bytes} [Thu Jul 14 17:44:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:44:51.648095 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-0ed7545f-b5c5-4fdb-8de3-c694c98ae63e admin admin] Calling method '>' {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:44:51.653653 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.wsgi [None req-0ed7545f-b5c5-4fdb-8de3-c694c98ae63e admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 14 17:44:51.655139 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-0ed7545f-b5c5-4fdb-8de3-c694c98ae63e admin admin] Request method failure captured: Jul 14 17:44:51.655139 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 14 17:44:51.655139 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: Accept: application/json Jul 14 17:44:51.655139 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: Accept-Encoding: gzip, deflate Jul 14 17:44:51.655139 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: Connection: keep-alive Jul 14 17:44:51.655139 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: Content-Length: 0 Jul 14 17:44:51.655139 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: Host: 10.222.0.64 Jul 14 17:44:51.655139 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: Openstack-Api-Version: compute 2.90 Jul 14 17:44:51.655139 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: Openstack-System-Scope: None Jul 14 17:44:51.655139 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: User-Agent: python-novaclient Jul 14 17:44:51.655139 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Auth-Token: gAAAAABi0FYSOLv1HbQEYkg-5XePDPJmZe1ieZNsJC4wrq2OjzrC_mMclLjBzM3jbyz54kBQszykIlfjdJFhVoo4mPNph4a-uFhLNtYqvfWSl6L9JY6uIygFRA3t70hbBckMPShdkyWdqAjdbkZPjHadqJ_l1V-48O2Btkqiv-ClWXYZuieJSEQ Jul 14 17:44:51.655139 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Domain-Id: None Jul 14 17:44:51.655139 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Domain-Name: None Jul 14 17:44:51.655139 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Identity-Status: Confirmed Jul 14 17:44:51.655139 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Is-Admin-Project: True Jul 14 17:44:51.655139 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 17:44:51.655139 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Project-Domain-Id: default Jul 14 17:44:51.655139 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Project-Domain-Name: Default Jul 14 17:44:51.655139 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Project-Id: 29b8bf26bc324367a4fe27e90fc2d6df Jul 14 17:44:51.655139 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Project-Name: admin Jul 14 17:44:51.655139 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Role: admin,reader,member Jul 14 17:44:51.655139 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Roles: admin,reader,member Jul 14 17:44:51.656758 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/29b8bf26bc324367a4fe27e90fc2d6df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/29b8bf26bc324367a4fe27e90fc2d6df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/29b8bf26bc324367a4fe27e90fc2d6df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_29b8bf26bc324367a4fe27e90fc2d6df", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 17:44:51.656758 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Tenant: admin Jul 14 17:44:51.656758 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Tenant-Id: 29b8bf26bc324367a4fe27e90fc2d6df Jul 14 17:44:51.656758 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-Tenant-Name: admin Jul 14 17:44:51.656758 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-User: admin Jul 14 17:44:51.656758 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-User-Domain-Id: default Jul 14 17:44:51.656758 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-User-Domain-Name: Default Jul 14 17:44:51.656758 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-User-Id: 7d77dedfd6bd435d94f994cfcde5100a Jul 14 17:44:51.656758 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: X-User-Name: admin Jul 14 17:44:51.656758 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: method: > Jul 14 17:44:51.656758 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: exception: Flavor 451 could not be found. Jul 14 17:44:51.656758 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: action_args: {'id': '451'} Jul 14 17:44:51.656758 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 17:44:51.656758 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:44:51.657755 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 17:44:51.657755 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 17:44:51.657755 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 17:44:51.657755 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 17:44:51.657755 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 17:44:51.657755 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 17:44:51.657755 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 17:44:51.657755 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 17:44:51.657755 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 17:44:51.657755 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 17:44:51.657755 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 17:44:51.657755 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 17:44:51.657755 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 14 17:44:51.657755 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi Jul 14 17:44:51.657755 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:44:51.657755 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi Jul 14 17:44:51.657755 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:44:51.657755 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:44:51.657755 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:44:51.659070 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 17:44:51.659070 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 17:44:51.659070 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 17:44:51.659070 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 17:44:51.659070 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 17:44:51.659070 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 17:44:51.659070 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 14 17:44:51.659070 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi Jul 14 17:44:51.659070 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:44:51.659070 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi Jul 14 17:44:51.659070 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:44:51.659070 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:44:51.659070 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:44:51.659070 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 17:44:51.659070 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 17:44:51.659070 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 14 17:44:51.659070 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: ERROR nova.api.openstack.wsgi Jul 14 17:44:51.659070 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-0ed7545f-b5c5-4fdb-8de3-c694c98ae63e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 17:44:51.660439 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.requestlog [None req-0ed7545f-b5c5-4fdb-8de3-c694c98ae63e admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012664 Jul 14 17:44:51.660439 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: [pid: 114929|app: 0|req: 27/52] 10.222.0.64 () {60 vars in 1193 bytes} [Thu Jul 14 17:44:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 17:44:52.652844 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-0d5d0862-e0af-45e8-990a-36b8b55534db admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:44:52.653856 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-0d5d0862-e0af-45e8-990a-36b8b55534db admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jul 14 17:44:52.654248 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 26/53] 10.222.0.64 () {56 vars in 1074 bytes} [Thu Jul 14 17:44:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:44:53.203263 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-ce4386eb-abb1-4307-bd67-8bb63ce5c3f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:44:53.223915 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.requestlog [None req-ce4386eb-abb1-4307-bd67-8bb63ce5c3f1 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.428751 Jul 14 17:44:53.224416 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: [pid: 114929|app: 0|req: 28/54] 10.222.0.64 () {64 vars in 1235 bytes} [Thu Jul 14 17:44:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 17:44:54.261980 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-0d5d0862-e0af-45e8-990a-36b8b55534db admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:44:54.263015 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-0d5d0862-e0af-45e8-990a-36b8b55534db admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jul 14 17:44:54.263410 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 27/55] 10.222.0.64 () {56 vars in 1074 bytes} [Thu Jul 14 17:44:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:44:54.827377 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-51985a89-b229-4d80-9b4c-10324ffd1d39 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:44:54.852575 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.requestlog [None req-51985a89-b229-4d80-9b4c-10324ffd1d39 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.448133 Jul 14 17:44:54.853718 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: [pid: 114929|app: 0|req: 29/56] 10.222.0.64 () {64 vars in 1235 bytes} [Thu Jul 14 17:44:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 17:44:55.881142 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-0d5d0862-e0af-45e8-990a-36b8b55534db admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:44:55.882212 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-0d5d0862-e0af-45e8-990a-36b8b55534db admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Jul 14 17:44:55.882666 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 28/57] 10.222.0.64 () {56 vars in 1074 bytes} [Thu Jul 14 17:44:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:44:56.449944 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-7914f495-c437-4a2f-82b9-aaf6710a8a14 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:44:56.468123 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.requestlog [None req-7914f495-c437-4a2f-82b9-aaf6710a8a14 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.448770 Jul 14 17:44:56.468672 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: [pid: 114929|app: 0|req: 30/58] 10.222.0.64 () {64 vars in 1235 bytes} [Thu Jul 14 17:44:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 17:44:57.537415 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-0d5d0862-e0af-45e8-990a-36b8b55534db admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:44:57.538563 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-0d5d0862-e0af-45e8-990a-36b8b55534db admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jul 14 17:44:57.539156 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 29/59] 10.222.0.64 () {56 vars in 1074 bytes} [Thu Jul 14 17:44:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:44:58.108577 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-67a17cd7-4b3c-46ef-8182-f7953a91c675 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:44:58.129604 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.requestlog [None req-67a17cd7-4b3c-46ef-8182-f7953a91c675 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.446996 Jul 14 17:44:58.130190 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: [pid: 114929|app: 0|req: 31/60] 10.222.0.64 () {64 vars in 1235 bytes} [Thu Jul 14 17:44:57 2022] POST /compute/v2.1/flavors => generated 409 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 17:44:59.154259 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-0d5d0862-e0af-45e8-990a-36b8b55534db admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:44:59.155395 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-0d5d0862-e0af-45e8-990a-36b8b55534db admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001702 Jul 14 17:44:59.155916 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 30/61] 10.222.0.64 () {56 vars in 1074 bytes} [Thu Jul 14 17:44:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:44:59.907717 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-f9e483d5-fc03-4960-a47e-e80f127f7b71 admin admin] Calling method '>' {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:44:59.947174 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.requestlog [None req-f9e483d5-fc03-4960-a47e-e80f127f7b71 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.650748 Jul 14 17:44:59.948233 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: [pid: 114929|app: 0|req: 32/62] 10.222.0.64 () {60 vars in 1202 bytes} [Thu Jul 14 17:44:59 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:45:53.655920 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-0d5d0862-e0af-45e8-990a-36b8b55534db admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:45:53.656930 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-0d5d0862-e0af-45e8-990a-36b8b55534db admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001759 Jul 14 17:45:53.657327 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 31/63] 10.222.0.64 () {54 vars in 930 bytes} [Thu Jul 14 17:45:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:45:53.668764 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG dbcounter [-] [114929] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=114929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:45:54.085148 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-f0ec3f1c-9d2b-4936-a346-7c1eb45fe661 admin admin] Calling method '>' {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:45:54.105342 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.requestlog [None req-f0ec3f1c-9d2b-4936-a346-7c1eb45fe661 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.441555 Jul 14 17:45:54.105898 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: [pid: 114929|app: 0|req: 33/64] 10.222.0.64 () {60 vars in 1291 bytes} [Thu Jul 14 17:45:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:45:54.126967 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG dbcounter [-] [114928] Writing DB stats nova_api:SELECT=14 {{(pid=114928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:45:54.132346 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-aee85c3e-deaa-4619-a32d-212101736fa6 admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:45:54.140910 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-aee85c3e-deaa-4619-a32d-212101736fa6 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015310 Jul 14 17:45:54.141467 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 32/65] 10.222.0.64 () {60 vars in 1282 bytes} [Thu Jul 14 17:45:54 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:45:54.153409 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-950cd7e6-945b-457e-899f-a503d5c51f2e admin admin] Calling method '>' {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:45:54.161527 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.requestlog [None req-950cd7e6-945b-457e-899f-a503d5c51f2e admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011775 Jul 14 17:45:54.162138 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: [pid: 114929|app: 0|req: 34/66] 10.222.0.64 () {60 vars in 1285 bytes} [Thu Jul 14 17:45:54 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:45:54.174832 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-6691ab2e-7ff9-48c2-aada-f1fcbaa75023 admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:45:54.183272 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-6691ab2e-7ff9-48c2-aada-f1fcbaa75023 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012574 Jul 14 17:45:54.183753 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 33/67] 10.222.0.64 () {60 vars in 1285 bytes} [Thu Jul 14 17:45:54 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:45:54.196078 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-edd4b0cf-e8a6-462d-957b-3079a3dc9084 admin admin] Calling method '>' {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:45:54.204059 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.requestlog [None req-edd4b0cf-e8a6-462d-957b-3079a3dc9084 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012082 Jul 14 17:45:54.204625 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: [pid: 114929|app: 0|req: 35/68] 10.222.0.64 () {60 vars in 1282 bytes} [Thu Jul 14 17:45:54 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:49:47.737450 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-6691ab2e-7ff9-48c2-aada-f1fcbaa75023 admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:49:47.738565 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-6691ab2e-7ff9-48c2-aada-f1fcbaa75023 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jul 14 17:49:47.738863 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 34/69] 10.222.0.64 () {56 vars in 1074 bytes} [Thu Jul 14 17:49:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:49:47.880860 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG dbcounter [-] [114929] Writing DB stats nova_api:SELECT=6 {{(pid=114929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:49:48.028880 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-c0e94a2a-15ac-429a-b0e6-f53208c68fb6 admin admin] Calling method '>' {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:49:48.030048 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 17:49:48.030048 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: warnings.warn(msg) Jul 14 17:49:48.031243 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG oslo_concurrency.lockutils [None req-c0e94a2a-15ac-429a-b0e6-f53208c68fb6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:49:48.031724 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG oslo_concurrency.lockutils [None req-c0e94a2a-15ac-429a-b0e6-f53208c68fb6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:49:48.032559 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG oslo_concurrency.lockutils [None req-c0e94a2a-15ac-429a-b0e6-f53208c68fb6 admin admin] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:49:48.032979 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG oslo_concurrency.lockutils [None req-c0e94a2a-15ac-429a-b0e6-f53208c68fb6 admin admin] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:49:48.066879 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.requestlog [None req-c0e94a2a-15ac-429a-b0e6-f53208c68fb6 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.187575 Jul 14 17:49:48.067433 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: [pid: 114929|app: 0|req: 36/70] 10.222.0.64 () {60 vars in 1193 bytes} [Thu Jul 14 17:49:47 2022] GET /compute/v2.1/os-services => generated 791 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 17:49:48.894719 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-6691ab2e-7ff9-48c2-aada-f1fcbaa75023 admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:49:48.895736 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-6691ab2e-7ff9-48c2-aada-f1fcbaa75023 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jul 14 17:49:48.896156 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 35/71] 10.222.0.64 () {56 vars in 1074 bytes} [Thu Jul 14 17:49:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:49:49.086616 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-1b65a5ac-e2d0-4d8f-a0c4-065c05787ae9 admin admin] Calling method '>' {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:49:49.087794 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 17:49:49.087794 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: warnings.warn(msg) Jul 14 17:49:49.089009 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG oslo_concurrency.lockutils [None req-1b65a5ac-e2d0-4d8f-a0c4-065c05787ae9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:49:49.089489 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG oslo_concurrency.lockutils [None req-1b65a5ac-e2d0-4d8f-a0c4-065c05787ae9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:49:49.090858 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG oslo_concurrency.lockutils [None req-1b65a5ac-e2d0-4d8f-a0c4-065c05787ae9 admin admin] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:49:49.091294 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG oslo_concurrency.lockutils [None req-1b65a5ac-e2d0-4d8f-a0c4-065c05787ae9 admin admin] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:49:49.110691 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.requestlog [None req-1b65a5ac-e2d0-4d8f-a0c4-065c05787ae9 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075480 Jul 14 17:49:49.111185 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: [pid: 114929|app: 0|req: 37/72] 10.222.0.64 () {60 vars in 1193 bytes} [Thu Jul 14 17:49:49 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 17:50:00.393166 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-6691ab2e-7ff9-48c2-aada-f1fcbaa75023 admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:50:00.394174 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-6691ab2e-7ff9-48c2-aada-f1fcbaa75023 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Jul 14 17:50:00.394569 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 36/73] 10.222.0.64 () {56 vars in 1074 bytes} [Thu Jul 14 17:50:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:50:00.539760 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG dbcounter [-] [114929] Writing DB stats nova_cell0:SELECT=4 {{(pid=114929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:50:00.540801 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG dbcounter [-] [114929] Writing DB stats nova_cell1:SELECT=4 {{(pid=114929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:50:00.541614 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG dbcounter [-] [114929] Writing DB stats nova_api:SELECT=8 {{(pid=114929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:50:00.589325 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-5839d246-a20d-424e-87ca-9a14530a52d1 admin admin] Calling method '>' {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:50:00.590488 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 17:50:00.590488 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: warnings.warn(msg) Jul 14 17:50:00.592405 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG oslo_concurrency.lockutils [None req-5839d246-a20d-424e-87ca-9a14530a52d1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:50:00.592851 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG oslo_concurrency.lockutils [None req-5839d246-a20d-424e-87ca-9a14530a52d1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:50:00.593640 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG oslo_concurrency.lockutils [None req-5839d246-a20d-424e-87ca-9a14530a52d1 admin admin] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:50:00.594071 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG oslo_concurrency.lockutils [None req-5839d246-a20d-424e-87ca-9a14530a52d1 admin admin] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:50:00.619099 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.requestlog [None req-5839d246-a20d-424e-87ca-9a14530a52d1 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.083673 Jul 14 17:50:00.619588 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: [pid: 114929|app: 0|req: 38/74] 10.222.0.64 () {60 vars in 1193 bytes} [Thu Jul 14 17:50:00 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:50:01.442936 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-6691ab2e-7ff9-48c2-aada-f1fcbaa75023 admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:50:01.443971 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-6691ab2e-7ff9-48c2-aada-f1fcbaa75023 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jul 14 17:50:01.444371 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 37/75] 10.222.0.64 () {56 vars in 1074 bytes} [Thu Jul 14 17:50:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:50:01.633344 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG nova.api.openstack.wsgi [None req-29e41881-221a-4527-9f8a-d9da7f68ccfb admin admin] Calling method '>' {{(pid=114929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:50:01.634555 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 17:50:01.634555 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: warnings.warn(msg) Jul 14 17:50:01.635759 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG oslo_concurrency.lockutils [None req-29e41881-221a-4527-9f8a-d9da7f68ccfb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:50:01.636251 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG oslo_concurrency.lockutils [None req-29e41881-221a-4527-9f8a-d9da7f68ccfb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:50:01.637051 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG oslo_concurrency.lockutils [None req-29e41881-221a-4527-9f8a-d9da7f68ccfb admin admin] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:50:01.637520 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: DEBUG oslo_concurrency.lockutils [None req-29e41881-221a-4527-9f8a-d9da7f68ccfb admin admin] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:50:01.659672 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: INFO nova.api.openstack.requestlog [None req-29e41881-221a-4527-9f8a-d9da7f68ccfb admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.077863 Jul 14 17:50:01.660186 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: [pid: 114929|app: 0|req: 39/76] 10.222.0.64 () {60 vars in 1193 bytes} [Thu Jul 14 17:50:01 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:50:58.929392 dv-cinder-849890-1-iscsi devstack@n-api.service[114927]: Thu Jul 14 17:50:58 2022 - graceful shutdown triggered... Jul 14 17:50:58.929532 dv-cinder-849890-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 14 17:50:58.930717 dv-cinder-849890-1-iscsi devstack@n-api.service[114928]: Gracefully killing worker 1 (pid: 114928)... Jul 14 17:50:58.931099 dv-cinder-849890-1-iscsi devstack@n-api.service[114929]: Gracefully killing worker 2 (pid: 114929)... Jul 14 17:50:59.931906 dv-cinder-849890-1-iscsi devstack@n-api.service[114927]: worker 1 buried after 1 seconds Jul 14 17:50:59.931906 dv-cinder-849890-1-iscsi devstack@n-api.service[114927]: worker 2 buried after 1 seconds Jul 14 17:50:59.931906 dv-cinder-849890-1-iscsi devstack@n-api.service[114927]: goodbye to uWSGI. Jul 14 17:50:59.933447 dv-cinder-849890-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 14 17:50:59.933996 dv-cinder-849890-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 14 17:50:59.936835 dv-cinder-849890-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 14 17:50:59.946019 dv-cinder-849890-1-iscsi devstack@n-api.service[129451]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 14 17:50:59.947975 dv-cinder-849890-1-iscsi devstack@n-api.service[129451]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 17:50:59 2022] *** Jul 14 17:50:59.947975 dv-cinder-849890-1-iscsi devstack@n-api.service[129451]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 17:50:59.947975 dv-cinder-849890-1-iscsi devstack@n-api.service[129451]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 17:50:59.947975 dv-cinder-849890-1-iscsi devstack@n-api.service[129451]: nodename: dv-cinder-849890-1-iscsi Jul 14 17:50:59.947975 dv-cinder-849890-1-iscsi devstack@n-api.service[129451]: machine: x86_64 Jul 14 17:50:59.947975 dv-cinder-849890-1-iscsi devstack@n-api.service[129451]: clock source: unix Jul 14 17:50:59.947975 dv-cinder-849890-1-iscsi devstack@n-api.service[129451]: pcre jit disabled Jul 14 17:50:59.947975 dv-cinder-849890-1-iscsi devstack@n-api.service[129451]: detected number of CPU cores: 4 Jul 14 17:50:59.947975 dv-cinder-849890-1-iscsi devstack@n-api.service[129451]: current working directory: / Jul 14 17:50:59.947975 dv-cinder-849890-1-iscsi devstack@n-api.service[129451]: detected binary path: /usr/bin/uwsgi-core Jul 14 17:50:59.948612 dv-cinder-849890-1-iscsi devstack@n-api.service[129451]: your processes number limit is 47680 Jul 14 17:50:59.948612 dv-cinder-849890-1-iscsi devstack@n-api.service[129451]: your memory page size is 4096 bytes Jul 14 17:50:59.948612 dv-cinder-849890-1-iscsi devstack@n-api.service[129451]: detected max file descriptor number: 2048 Jul 14 17:50:59.948612 dv-cinder-849890-1-iscsi devstack@n-api.service[129451]: lock engine: pthread robust mutexes Jul 14 17:50:59.948612 dv-cinder-849890-1-iscsi devstack@n-api.service[129451]: thunder lock: enabled Jul 14 17:50:59.948612 dv-cinder-849890-1-iscsi devstack@n-api.service[129451]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 14 17:50:59.948612 dv-cinder-849890-1-iscsi devstack@n-api.service[129451]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 14 17:50:59.995365 dv-cinder-849890-1-iscsi devstack@n-api.service[129451]: Python main interpreter initialized at 0x562853c159c0 Jul 14 17:50:59.995365 dv-cinder-849890-1-iscsi devstack@n-api.service[129451]: python threads support enabled Jul 14 17:50:59.995365 dv-cinder-849890-1-iscsi devstack@n-api.service[129451]: your server socket listen backlog is limited to 100 connections Jul 14 17:50:59.995365 dv-cinder-849890-1-iscsi devstack@n-api.service[129451]: your mercy for graceful operations on workers is 90 seconds Jul 14 17:50:59.995774 dv-cinder-849890-1-iscsi devstack@n-api.service[129451]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 17:50:59.995774 dv-cinder-849890-1-iscsi devstack@n-api.service[129451]: *** Operational MODE: preforking *** Jul 14 17:50:59.996103 dv-cinder-849890-1-iscsi devstack@n-api.service[129451]: *** uWSGI is running in multiple interpreter mode *** Jul 14 17:50:59.996103 dv-cinder-849890-1-iscsi devstack@n-api.service[129451]: spawned uWSGI master process (pid: 129451) Jul 14 17:50:59.996315 dv-cinder-849890-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 14 17:50:59.996626 dv-cinder-849890-1-iscsi devstack@n-api.service[129451]: spawned uWSGI worker 1 (pid: 129470, cores: 1) Jul 14 17:50:59.997477 dv-cinder-849890-1-iscsi devstack@n-api.service[129451]: spawned uWSGI worker 2 (pid: 129471, cores: 1) Jul 14 17:50:59.997760 dv-cinder-849890-1-iscsi devstack@n-api.service[129451]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 17:51:00.660625 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 17:51:00.672512 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 17:51:01.865653 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 17:51:01.865653 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: from cryptography.utils import int_from_bytes Jul 14 17:51:01.866338 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 17:51:01.866338 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: from cryptography.utils import int_from_bytes Jul 14 17:51:01.876437 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 17:51:01.876437 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: from cryptography.utils import int_from_bytes Jul 14 17:51:01.877010 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 17:51:01.877010 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: from cryptography.utils import int_from_bytes Jul 14 17:51:04.177466 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 17:51:04.178117 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 17:51:04.178349 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 17:51:04.178633 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 17:51:04.178896 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 17:51:04.179288 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.179617 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.179960 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.180293 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.180627 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.181197 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.181523 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.181845 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.182176 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.182442 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.182778 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.183089 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849890-1-iscsi {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.183413 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.183724 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.184060 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.184386 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.184696 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.185024 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.185340 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.185845 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.191547 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.191547 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.191547 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.191547 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.191547 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.191547 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.191547 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.191547 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.192656 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.192656 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.192656 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849890-1-iscsi {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.192656 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.192656 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.192656 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.192656 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.192656 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.193230 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.193230 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.193230 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.193230 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.193230 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.193583 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.193909 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.194070 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.194756 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.194756 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.195111 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.195270 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.195518 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.195829 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.196110 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.196426 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.196750 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.197074 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.197402 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.197655 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.197909 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.198236 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.198554 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.198863 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.199173 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.199482 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.199788 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.200128 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.200440 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.200749 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.201059 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.201383 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.201700 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.202025 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.202335 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.202657 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.203061 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.203315 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.203624 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.204035 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.204314 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.204626 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.204946 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.205272 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.206122 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.206438 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.206764 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.207078 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.207433 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.207695 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.208023 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.208284 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.208590 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.208908 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.209218 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.209526 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.209835 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.210138 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.210448 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.210758 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.211067 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.211377 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.211530 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 17:51:04.212074 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.212241 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 17:51:04.212393 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.212552 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 17:51:04.212706 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.212706 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.212993 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 17:51:04.212993 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 17:51:04.213298 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.213298 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.213583 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.213735 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.213890 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.214057 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.214219 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.214385 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.214614 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.214766 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.214922 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.215079 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.215233 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.215386 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.215542 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.215716 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.215864 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.216111 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.216422 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.216582 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.216762 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.217088 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.217351 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.217698 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.217859 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849890-1-iscsi {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.218017 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.218301 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.218462 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.218634 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.218900 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.219069 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.219225 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.219382 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.219528 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.219684 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.219839 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.220033 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.220195 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.220358 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.220505 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.220505 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.220797 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.220973 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.221839 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.222040 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.222211 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.222370 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.222528 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.222674 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.222836 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.223634 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.223803 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.223981 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.224148 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.224308 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.224474 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.224627 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.224774 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.224927 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.225074 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.225233 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.225389 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.225551 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.225551 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.225840 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849890-1-iscsi {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.226072 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.226229 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.226807 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.226994 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.227370 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.227642 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.228122 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.228298 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.228572 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.228731 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.228903 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.229187 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.229345 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.229492 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.229655 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.229801 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.229946 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.230101 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.230255 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.230409 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.230554 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.230700 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.230854 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.231021 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.231175 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.231330 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.231483 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.231785 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.231970 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.232136 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.232291 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.232441 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.232597 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.232743 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.232902 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.233055 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.233211 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.233365 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.233519 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.233802 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.233983 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.234133 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.234277 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.234432 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.234579 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.234723 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.234884 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.235042 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.235202 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.235348 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.235348 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.235665 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.235819 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.235999 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.236153 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.236307 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.236463 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.236657 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.237011 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.237172 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.237525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.237792 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.238149 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.238329 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.238483 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.238766 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.238945 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.239244 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.239532 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.239685 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.239839 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.240041 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.240195 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.240432 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.240598 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.240754 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.240919 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.241072 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.241227 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.241373 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.241531 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.241686 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.241686 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.241978 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.241978 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.242264 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.242434 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.242592 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.242747 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.242911 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.243066 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.243228 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.243394 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.243739 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.243901 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.244083 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.244244 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.244401 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.244556 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.244710 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.244862 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.245016 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.245173 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.245328 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.245485 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.245637 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.245790 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.245937 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.245937 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.246221 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.246221 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.246504 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.246649 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.246795 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.247146 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.247314 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.247629 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.247814 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.248308 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.248464 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.248627 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.248801 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.249062 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.249239 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.249485 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.249950 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.250112 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.250284 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.250442 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.250597 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.250752 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.250907 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.251066 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.251218 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.251372 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.251526 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.251691 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.251858 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.252031 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.252196 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.252448 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.252597 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.252778 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.252992 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.253143 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.253304 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.253451 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.253596 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.253754 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.253908 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.254069 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.254224 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.254377 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.254542 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.254698 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.254853 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.255000 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.255146 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.255293 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.255449 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.255595 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.255741 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.255888 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.256061 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.256220 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.256454 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.256620 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.256777 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.256924 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.257070 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.257435 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.257641 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.257892 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.258044 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.258490 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.258644 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.258790 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.258950 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.259255 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.259417 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.259679 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.259850 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.260235 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.260402 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.260557 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.260704 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.260850 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.260995 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.261158 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.261313 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.261472 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.261643 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.261799 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.261945 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.262104 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.262252 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.262407 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.262553 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.262707 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.265340 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.265542 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.265710 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.265862 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.266023 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.266276 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.266442 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.266599 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.266758 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.266917 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.267064 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.267259 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:51:04.267620 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.267775 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.268800 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.268959 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.269106 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.269272 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.269561 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.269814 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.270018 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.270170 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.270444 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.270597 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.270759 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.270906 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.271052 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.271204 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.271351 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.271506 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.271673 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.271821 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.272040 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.272204 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.272359 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.272534 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.272811 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.272994 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.273151 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.273299 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.273444 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.273606 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.273753 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.273918 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.274065 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.274219 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.274375 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.274531 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.274685 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.274840 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.275007 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.275153 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.275314 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.275467 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.275620 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.275776 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.275951 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.276104 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.276263 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.276410 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.276562 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.276708 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.276854 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.277000 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.277160 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.277160 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.277525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.277816 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.277988 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.278136 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.278296 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.278450 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.278914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.279069 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.279231 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.279395 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.279569 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.279826 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.280100 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.280254 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.280407 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.280693 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.280853 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.281002 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.281148 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.281293 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.281438 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.281599 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.281747 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.281893 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.282047 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.282194 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.282347 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.282512 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.282682 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.282830 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.282982 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.283137 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.283249 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.283338 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.283419 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.283510 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.284296 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.284389 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.284486 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.284575 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.284672 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.284759 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.284845 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.284938 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.285045 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.285134 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.285228 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.285314 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.285422 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.285517 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.285614 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.285708 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.285802 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.285896 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.285982 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.286074 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.286169 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.286256 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.287009 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.287106 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.287193 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.287295 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.287392 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.287488 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.287582 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.287676 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.288033 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.288154 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.288254 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.288342 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.288436 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.288533 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.288620 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.288735 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.289216 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.289314 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.289402 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.289497 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.289584 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.289684 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.289779 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.289883 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.289969 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.290256 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.290436 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.290527 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.290613 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.290715 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.290810 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.290908 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.291008 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.291096 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.291188 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.291289 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.291377 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.291462 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.291561 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.291656 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.291750 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.291837 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.291939 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.292041 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.292139 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.292233 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.292328 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.292430 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.292526 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.292626 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.292626 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.292793 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.292881 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.292966 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.293050 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.293149 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.293236 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.293321 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.293414 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.293414 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.293567 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.293662 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.293662 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.293662 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.293662 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.293662 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.294063 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.294158 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.294158 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.294325 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.294410 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.294502 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.294608 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.294608 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.294608 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.294844 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.294927 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.294927 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.295097 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.295193 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.295193 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.295368 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.295464 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.295464 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.295464 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.295464 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.295789 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.295888 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.295888 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.296243 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.296331 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.296331 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.296331 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.296331 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.296331 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.296740 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.296835 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.296835 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.296835 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.296835 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.296835 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.296835 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.297300 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.297386 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.297386 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.297386 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.297386 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.297386 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.297386 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.297876 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.298206 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.298206 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.298206 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.298206 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.298533 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.298627 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.298627 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.298627 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.298881 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.299398 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.299398 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.299398 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.299398 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.299766 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.299854 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.299854 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.300131 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.300257 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.300545 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.300753 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.300855 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.301057 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.301325 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.301444 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.301670 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.301956 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.302052 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.302446 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.302558 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.302659 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.302882 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.303160 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.303263 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.303488 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.303799 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.304005 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.304165 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.304361 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.304518 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.304732 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.304873 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.305033 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.305330 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.305500 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.305656 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.306094 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.306258 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.306546 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.306709 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.306851 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.307049 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.307215 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.307402 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.307568 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.307729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.308039 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.308308 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.308308 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.308618 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.308715 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.308930 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.309224 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.309601 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.309601 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.309824 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.309940 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.310154 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.310361 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.310753 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.310753 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.310946 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.311033 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.311345 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.311535 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.311653 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.311991 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.312159 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.312302 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.312608 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.312736 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.312914 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.313239 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.313335 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.313552 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.313848 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.313957 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.314153 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.314454 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.314550 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.314931 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.317569 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.317679 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.320448 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.321091 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.321173 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.321277 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.321367 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.321481 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.321588 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.322861 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.322965 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.323060 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.323225 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.323325 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.323409 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.323484 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.323484 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.323622 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.323693 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.323787 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.323976 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.324067 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.324141 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.324226 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.324335 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.324438 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.324527 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.324609 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.324689 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.324783 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.324857 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.324952 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.325026 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.325105 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.325198 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.325280 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.325373 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.325373 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.325539 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.325621 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.325621 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.325621 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.325814 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.325913 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.325913 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.326078 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.326158 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.326158 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.326158 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.326158 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.326158 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.326158 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.326158 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.326158 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.326681 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.326681 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.326681 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.326681 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.326681 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.327013 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.327268 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.327675 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.327792 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.327869 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.328349 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.328670 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.328907 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.329005 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.329293 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.329610 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.329883 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.329993 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.331401 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.331517 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.331617 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.331713 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.331827 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.331827 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.332284 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.332443 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.332443 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.332728 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.332890 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.333029 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.333334 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.333437 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.333645 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.333921 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.334065 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.334267 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.334524 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.334627 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.334870 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.335115 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.335279 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.335492 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.335717 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.335826 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.336554 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.336657 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.336657 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.336850 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.336967 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.337277 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.337437 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.337595 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.338098 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.338209 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.338311 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.338543 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.338689 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.338873 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.339137 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.339242 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.339493 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.339738 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.339843 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.340148 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.340474 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.340585 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.340780 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.340915 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.341748 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.341861 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.341947 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.341947 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.342131 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.342219 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.342332 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.342654 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.342757 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.343080 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.343226 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.343406 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.343708 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.343801 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.344133 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.344312 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.344469 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.344779 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.344951 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.345089 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.345406 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.345516 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.345717 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.346088 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.346681 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.346914 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.347173 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.347285 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.347535 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.347784 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.347879 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.348289 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.348484 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.348690 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.348794 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.349121 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.349279 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.349431 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.349760 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.350083 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.350707 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.350802 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.350889 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.350976 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.351073 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.352226 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.352359 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.352452 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.352535 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.352616 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.352616 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.352909 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.353000 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.353086 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.353178 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.353275 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.353369 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.353456 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.353541 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.353635 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.353865 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.353970 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.354199 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.354293 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.354515 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.354609 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.354832 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.354940 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.355143 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.355249 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.355484 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.355810 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.356026 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.356167 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.356280 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.356480 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.356761 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.356902 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.357099 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.357184 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.357421 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.357533 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.357753 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.357856 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.358085 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.358193 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.358472 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.358613 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.358698 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.358772 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.359065 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.359251 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.359347 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.359442 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.359578 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.359685 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.359886 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.360140 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.360300 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.360459 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.360606 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.360965 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.361134 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.361584 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.361784 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.361917 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.362040 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.362040 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.362521 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.362668 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.362812 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.362961 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.363095 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.363095 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.363345 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.363596 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.363868 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.364146 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.364334 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.364545 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.364724 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.364861 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.365005 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.365139 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.365272 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.365272 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.365522 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.365700 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.365848 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.365983 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.366124 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.366258 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.366390 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.366521 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.366704 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.366855 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.366997 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.367115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.367246 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.367388 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.367521 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.367653 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.367816 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.367973 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.368109 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.368109 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.368375 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.368507 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.368780 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.368947 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.369084 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.369227 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.369367 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.369499 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.369632 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.369771 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.369904 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.370033 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.370184 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.370322 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.370453 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.370578 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.370738 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.371049 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.371209 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.371344 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.371476 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.371765 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.371915 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.372063 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.372191 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.372327 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.372777 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.372924 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.372924 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.373236 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.373372 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.373662 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.373804 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.373953 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.374821 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.374991 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.375195 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.375347 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.375495 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.375658 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.375818 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.376005 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.376158 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.376305 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.376453 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.376612 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.376759 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.376927 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.377083 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.377360 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.377511 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.377659 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.377805 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.377959 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.378113 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.378277 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.378433 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.378589 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.378755 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.379023 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.379244 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.379397 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.379397 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.379397 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.379827 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.379981 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.380131 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.380131 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.380384 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.380384 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.380384 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.380751 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.380893 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.381196 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.381370 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.381512 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.381512 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.381953 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.382105 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.382230 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.382349 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.382473 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.382710 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.382976 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.383113 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.383285 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.383430 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.383564 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.383703 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.383848 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.384035 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.384171 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.384294 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.384409 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.384523 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.384647 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.384762 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.384883 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.384999 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.385112 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.385232 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.385393 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.385518 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.385518 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.385769 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.385937 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.386180 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.386315 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.386448 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.386580 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.386711 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.386842 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.386985 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.387118 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.387249 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.387414 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.387414 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.387692 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.387835 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.387986 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.388132 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.388274 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.388415 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.388558 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.388699 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.388840 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.388973 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.389228 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.389365 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.389542 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.389678 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.389819 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.389960 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.390094 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.390235 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.390383 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.390527 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.390661 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.390793 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.390932 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.391066 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.391369 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.391541 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.391677 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.391810 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.392226 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.392354 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.392505 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.392639 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.393403 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.393655 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.393791 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.393940 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.394075 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.394208 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.394348 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.394488 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.394621 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.394762 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.394903 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.395037 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.395170 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.395303 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.395435 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.395577 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.395718 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.395858 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.396018 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.396161 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.396296 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.396443 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.396577 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.396709 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.396850 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.396983 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.397129 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.397270 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.397404 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.397536 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.397676 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.397817 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.397966 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.398106 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.398249 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.398417 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.398560 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.398694 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.398836 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.398970 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.399109 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.399257 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.399554 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.399698 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.399842 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.400033 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.400169 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.400302 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.400442 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.400586 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.400720 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.400879 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.401778 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.401928 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.402064 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.402350 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.402479 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.402621 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.402745 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.402892 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.403167 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.403315 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.403450 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.403582 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.403582 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.403957 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.404120 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.404304 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.404448 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.404590 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.404724 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.404856 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.404856 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.405126 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.405260 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.405392 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.405525 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.405657 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.405804 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.405938 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.406095 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.406229 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.406362 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.406495 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.406495 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.406756 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.406756 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.408225 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.408387 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.408586 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.409225 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.409372 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.409531 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.409805 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.409943 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.410087 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.410221 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.410354 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.410495 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.410629 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.410762 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.410912 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.411048 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.411189 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.411331 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.411472 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.411606 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.411606 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.412054 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.412200 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.412497 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.412641 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.412786 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.412921 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.413069 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.413285 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.413430 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.413564 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.413711 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.413868 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.414091 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.414231 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.414365 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.414498 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.414643 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.414777 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.414918 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.415053 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.415186 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.415186 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.415457 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.415592 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.415725 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.415979 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.416109 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.416256 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.416376 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.416554 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.416705 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.416848 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.417016 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.417264 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.417403 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.417564 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.417699 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.417906 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.418083 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.418231 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.418511 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.418647 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.418789 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.418964 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.419143 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.419278 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.419427 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.419562 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.419695 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.419978 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.420133 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.420133 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.420404 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.420540 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.420673 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.420817 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.420960 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.421127 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.421287 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.421427 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.421569 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.421713 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.422005 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.422146 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.422279 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.422428 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.422697 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.422845 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.422977 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.423092 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.423372 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.423511 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.423654 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.423799 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.423982 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.424169 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.424398 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.424542 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.424678 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.424831 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.424965 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.425098 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.425260 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.425419 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.425561 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.425709 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.425843 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.425975 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.426107 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.426247 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.426394 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.426535 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.426675 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.426818 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.426951 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.427084 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.427226 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.427430 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.427574 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.427716 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.427851 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.428025 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.428180 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.428316 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.428457 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.428598 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.428739 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.428889 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.429030 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.429170 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.429304 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.429478 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.429605 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.429752 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.429885 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.430124 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.430262 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.430395 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.430528 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.430678 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.431062 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.431194 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.431325 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.431503 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.431639 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.431781 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.431946 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.432101 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.432438 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.432690 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.432904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.433043 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.433185 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.433328 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.433557 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.433718 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.433875 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.434113 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.434269 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.434420 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.434634 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.434810 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.434962 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.435097 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.435233 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.435376 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.435511 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.435680 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.435825 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.435990 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.436135 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.436270 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.436402 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.436550 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.436692 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.436866 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.436993 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.437135 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.437270 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.437422 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.437591 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.437733 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.437867 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.437999 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.438131 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.438273 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.438415 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.438548 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.438680 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.438812 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.438980 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.439119 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.439251 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.439383 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.439514 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.439680 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.440495 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.440636 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.440784 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.440918 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.441084 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.441220 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.441363 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.441363 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.441667 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.441802 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.441934 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.441934 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.442185 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.442472 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.442612 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.442832 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.443098 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.443245 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.443378 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.443526 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.443784 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.443950 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.444097 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.444242 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 17:51:04.444377 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.444377 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.444377 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.444377 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.444377 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.444377 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.444377 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.444377 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.445483 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.445483 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.445483 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.445483 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.445483 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.445483 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.446289 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.446289 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.446289 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.446758 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.446897 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.447093 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.447405 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.447723 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.448063 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.448382 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.448693 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.449010 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.449326 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.449659 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.450000 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.450324 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.450648 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.450965 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.451284 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.451869 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.452218 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.452560 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.452891 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.453242 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.453563 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.453887 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.454276 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.454533 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.454841 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.455155 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.456035 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.456346 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.456674 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.456992 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.457302 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.457623 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.457935 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.458531 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.458881 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.459201 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.459526 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.459851 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.460209 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.460518 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.460844 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.461150 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.461456 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.461773 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.462084 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.462389 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.462696 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.463011 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.463320 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.463626 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.463952 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.464264 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.464595 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.464899 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.465205 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.465511 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.465826 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.466131 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.466434 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.466741 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.467049 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.467359 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.467692 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.468033 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.468341 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.468655 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.468961 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.469272 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.469632 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.469964 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.470275 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.470581 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.470906 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.471259 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.471582 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.471896 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.472242 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.472599 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.472918 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.473605 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.473857 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.474178 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.474520 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.474854 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.475164 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.475472 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.475779 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.476134 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.476451 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.476763 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.477082 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.477401 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.477716 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.478028 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.478340 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.478651 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.478962 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.479275 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.479584 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.480012 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.480235 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.480557 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.480917 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.481385 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.481564 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.481885 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.482204 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.482517 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.482827 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.483139 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.483508 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.483767 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.484148 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.484469 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.484783 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.485218 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.485536 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.485860 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.486185 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.486494 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.486867 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.487226 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.487545 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.487868 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.488206 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.488543 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.488889 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.489222 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.489549 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.489855 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.490168 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.490478 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.490793 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.491116 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.491427 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.491737 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.492069 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.492382 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.492689 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.493000 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.493306 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.493618 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.493924 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.494231 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.494538 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.494844 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.495150 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.495455 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.495759 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.496115 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.496422 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.496736 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.497043 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.497352 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.497683 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.498029 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.498362 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.498681 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.499004 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.499317 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.499641 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.499970 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.500308 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.500632 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.500952 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.501264 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.501600 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.501910 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.502223 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.503059 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.503376 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.503807 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.504042 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.504375 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.504703 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.505014 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.505482 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.505666 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.505997 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.506315 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.506628 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.506961 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.507280 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.507593 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.507903 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.508237 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.508549 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.508868 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.509179 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.509492 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.509807 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.510124 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.510457 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.510786 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.511098 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.511426 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.511754 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.512139 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.512454 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.512809 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.513141 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.513458 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.513774 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.514082 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:51:04.514329 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 17:51:04.593731 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO dbcounter [None req-89a894b9-93b2-449a-90ed-b48bc526975f None None] Registered counter for database nova_api Jul 14 17:51:04.614056 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_db.sqlalchemy.engines [None req-89a894b9-93b2-449a-90ed-b48bc526975f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 17:51:04.620773 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writer thread running {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 17:51:04.666054 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO dbcounter [None req-dd72d224-c09c-453d-8318-46ae993c44e1 None None] Registered counter for database nova_api Jul 14 17:51:04.677429 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.context [None req-89a894b9-93b2-449a-90ed-b48bc526975f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4eefd466-1950-4d22-9e5e-a86218979b69(cell1) {{(pid=129470) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 17:51:04.681880 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-89a894b9-93b2-449a-90ed-b48bc526975f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:51:04.683489 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-89a894b9-93b2-449a-90ed-b48bc526975f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:51:04.684369 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-89a894b9-93b2-449a-90ed-b48bc526975f None None] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:51:04.685806 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_db.sqlalchemy.engines [None req-dd72d224-c09c-453d-8318-46ae993c44e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129471) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 17:51:04.686380 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-89a894b9-93b2-449a-90ed-b48bc526975f None None] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:51:04.688433 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO dbcounter [None req-89a894b9-93b2-449a-90ed-b48bc526975f None None] Registered counter for database nova_cell0 Jul 14 17:51:04.693078 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writer thread running {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 17:51:04.693217 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO dbcounter [None req-89a894b9-93b2-449a-90ed-b48bc526975f None None] Registered counter for database nova_cell1 Jul 14 17:51:04.700460 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_db.sqlalchemy.engines [None req-89a894b9-93b2-449a-90ed-b48bc526975f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 17:51:04.701774 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_db.sqlalchemy.engines [None req-89a894b9-93b2-449a-90ed-b48bc526975f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 17:51:04.710798 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writer thread running {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 17:51:04.711160 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writer thread running {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 17:51:04.750808 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.context [None req-dd72d224-c09c-453d-8318-46ae993c44e1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4eefd466-1950-4d22-9e5e-a86218979b69(cell1) {{(pid=129471) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 17:51:04.755686 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-dd72d224-c09c-453d-8318-46ae993c44e1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:51:04.757375 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-dd72d224-c09c-453d-8318-46ae993c44e1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:51:04.758297 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-dd72d224-c09c-453d-8318-46ae993c44e1 None None] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:51:04.760389 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-dd72d224-c09c-453d-8318-46ae993c44e1 None None] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:51:04.762492 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO dbcounter [None req-dd72d224-c09c-453d-8318-46ae993c44e1 None None] Registered counter for database nova_cell0 Jul 14 17:51:04.767077 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO dbcounter [None req-dd72d224-c09c-453d-8318-46ae993c44e1 None None] Registered counter for database nova_cell1 Jul 14 17:51:04.775349 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_db.sqlalchemy.engines [None req-dd72d224-c09c-453d-8318-46ae993c44e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129471) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 17:51:04.778224 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_db.sqlalchemy.engines [None req-dd72d224-c09c-453d-8318-46ae993c44e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129471) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 17:51:04.782563 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writer thread running {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 17:51:04.864801 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO dbcounter [None req-89a894b9-93b2-449a-90ed-b48bc526975f None None] Registered counter for database nova_cell0 Jul 14 17:51:04.872572 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_db.sqlalchemy.engines [None req-89a894b9-93b2-449a-90ed-b48bc526975f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 17:51:04.878648 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writer thread running {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 17:51:04.923301 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writer thread running {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 17:51:04.934763 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO dbcounter [None req-dd72d224-c09c-453d-8318-46ae993c44e1 None None] Registered counter for database nova_cell0 Jul 14 17:51:04.944276 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_db.sqlalchemy.engines [None req-dd72d224-c09c-453d-8318-46ae993c44e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129471) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 17:51:04.948953 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writer thread running {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 17:51:05.197855 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: WARNING keystonemiddleware.auth_token [None req-89a894b9-93b2-449a-90ed-b48bc526975f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 17:51:05.205380 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: WARNING keystonemiddleware.auth_token [None req-89a894b9-93b2-449a-90ed-b48bc526975f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 17:51:05.274493 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: WARNING keystonemiddleware.auth_token [None req-dd72d224-c09c-453d-8318-46ae993c44e1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 17:51:05.281907 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: WARNING keystonemiddleware.auth_token [None req-dd72d224-c09c-453d-8318-46ae993c44e1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 17:51:05.547500 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: WARNING keystonemiddleware.auth_token [None req-89a894b9-93b2-449a-90ed-b48bc526975f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 17:51:05.553884 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: WARNING keystonemiddleware.auth_token [None req-89a894b9-93b2-449a-90ed-b48bc526975f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 17:51:05.560771 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562853c159c0 pid: 129470 (default app) Jul 14 17:51:05.624596 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: WARNING keystonemiddleware.auth_token [None req-dd72d224-c09c-453d-8318-46ae993c44e1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 17:51:05.631145 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: WARNING keystonemiddleware.auth_token [None req-dd72d224-c09c-453d-8318-46ae993c44e1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 17:51:05.637544 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562853c159c0 pid: 129471 (default app) Jul 14 17:51:46.935447 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_api:SELECT=3 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:51:46.937515 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell0:SELECT=3 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:51:46.939961 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=3 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:51:46.942012 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell0:SELECT=3 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:51:48.479197 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-155ce9bd-dc33-4912-9ffb-8f33ab65a17a tempest-VolumesGetTestJSON-1108363255 tempest-VolumesGetTestJSON-1108363255-project] Action: 'create', calling method: .version_select at 0x7f13817aaca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-425715575", "metadata": {"Type": "work"}}} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:51:49.807358 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-155ce9bd-dc33-4912-9ffb-8f33ab65a17a tempest-VolumesGetTestJSON-1108363255 tempest-VolumesGetTestJSON-1108363255-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.888243 Jul 14 17:51:49.808888 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 1/1] 10.222.0.64 () {60 vars in 1155 bytes} [Thu Jul 14 17:51:46 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2891 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 14 17:51:49.826206 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_api:SELECT=3 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:51:49.831578 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell0:SELECT=3 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:51:49.832596 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=3 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:51:49.836464 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell0:SELECT=3 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:51:50.266649 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-e71a923c-364f-4da5-a390-1bb50a132975 tempest-VolumesGetTestJSON-1108363255 tempest-VolumesGetTestJSON-1108363255-project] Calling method '.version_select at 0x7f138178c790>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:51:50.878907 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-e71a923c-364f-4da5-a390-1bb50a132975 tempest-VolumesGetTestJSON-1108363255 tempest-VolumesGetTestJSON-1108363255-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/ff17b090-5761-43ec-9a0b-6c11de385e06" status: 200 len: 353 microversion: 2.1 time: 1.060281 Jul 14 17:51:50.883987 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 1/2] 10.222.0.64 () {58 vars in 1244 bytes} [Thu Jul 14 17:51:49 2022] GET /compute/v2.1/os-volumes/ff17b090-5761-43ec-9a0b-6c11de385e06 => generated 353 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:51:50.893560 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-2f8011c7-5ca4-43aa-b3ec-e1079f0be4b5 tempest-VolumesGetTestJSON-1108363255 tempest-VolumesGetTestJSON-1108363255-project] Calling method '.version_select at 0x7f1381607af0>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:51:51.014330 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-2f8011c7-5ca4-43aa-b3ec-e1079f0be4b5 tempest-VolumesGetTestJSON-1108363255 tempest-VolumesGetTestJSON-1108363255-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/ff17b090-5761-43ec-9a0b-6c11de385e06" status: 200 len: 353 microversion: 2.1 time: 0.125828 Jul 14 17:51:51.015886 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 2/3] 10.222.0.64 () {58 vars in 1244 bytes} [Thu Jul 14 17:51:50 2022] GET /compute/v2.1/os-volumes/ff17b090-5761-43ec-9a0b-6c11de385e06 => generated 353 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:51:51.037041 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-e2ef638f-9577-4c48-8cf2-e06ccb8b7c89 tempest-VolumesGetTestJSON-1108363255 tempest-VolumesGetTestJSON-1108363255-project] Calling method '.version_select at 0x7f1381651a60>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:51:51.161248 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-51745462-be54-4f7e-adcc-0ba5f4a85935 tempest-VolumesTestJSON-2018408631 tempest-VolumesTestJSON-2018408631-project] Calling method '.version_select at 0x7f1381607c10>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:51:51.246597 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-e2ef638f-9577-4c48-8cf2-e06ccb8b7c89 tempest-VolumesGetTestJSON-1108363255 tempest-VolumesGetTestJSON-1108363255-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/ff17b090-5761-43ec-9a0b-6c11de385e06" status: 202 len: 0 microversion: 2.1 time: 0.214689 Jul 14 17:51:51.247170 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 2/4] 10.222.0.64 () {58 vars in 1247 bytes} [Thu Jul 14 17:51:51 2022] DELETE /compute/v2.1/os-volumes/ff17b090-5761-43ec-9a0b-6c11de385e06 => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 17:51:51.257062 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-74978952-7313-4423-872d-f7dc6b58f607 tempest-VolumesGetTestJSON-1108363255 tempest-VolumesGetTestJSON-1108363255-project] Calling method '.version_select at 0x7f138160f160>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:51:51.323745 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-51745462-be54-4f7e-adcc-0ba5f4a85935 tempest-VolumesTestJSON-2018408631 tempest-VolumesTestJSON-2018408631-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/067698ba-3d7c-4781-879c-bf4376bd8e84" status: 200 len: 351 microversion: 2.1 time: 0.166462 Jul 14 17:51:51.324352 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 3/5] 10.222.0.64 () {58 vars in 1244 bytes} [Thu Jul 14 17:51:51 2022] GET /compute/v2.1/os-volumes/067698ba-3d7c-4781-879c-bf4376bd8e84 => generated 351 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 17:51:51.394307 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-74978952-7313-4423-872d-f7dc6b58f607 tempest-VolumesGetTestJSON-1108363255 tempest-VolumesGetTestJSON-1108363255-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/ff17b090-5761-43ec-9a0b-6c11de385e06" status: 200 len: 352 microversion: 2.1 time: 0.142905 Jul 14 17:51:51.394880 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 3/6] 10.222.0.64 () {58 vars in 1244 bytes} [Thu Jul 14 17:51:51 2022] GET /compute/v2.1/os-volumes/ff17b090-5761-43ec-9a0b-6c11de385e06 => generated 352 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 17:51:52.408968 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-be87be7f-6913-456d-baf7-88f33066cc9c tempest-VolumesGetTestJSON-1108363255 tempest-VolumesGetTestJSON-1108363255-project] Calling method '.version_select at 0x7f1381621310>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:51:52.462947 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.wsgi [None req-be87be7f-6913-456d-baf7-88f33066cc9c tempest-VolumesGetTestJSON-1108363255 tempest-VolumesGetTestJSON-1108363255-project] HTTP exception thrown: Volume ff17b090-5761-43ec-9a0b-6c11de385e06 could not be found. Jul 14 17:51:52.467615 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-be87be7f-6913-456d-baf7-88f33066cc9c tempest-VolumesGetTestJSON-1108363255 tempest-VolumesGetTestJSON-1108363255-project] Request method failure captured: Jul 14 17:51:52.467615 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: request: GET /compute/v2.1/os-volumes/ff17b090-5761-43ec-9a0b-6c11de385e06 HTTP/1.1 Jul 14 17:51:52.467615 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept: application/json Jul 14 17:51:52.467615 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept-Encoding: identity Jul 14 17:51:52.467615 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Connection: close Jul 14 17:51:52.467615 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Length: 0 Jul 14 17:51:52.467615 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Type: application/json Jul 14 17:51:52.467615 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Host: 10.222.0.64 Jul 14 17:51:52.467615 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Openstack-System-Scope: None Jul 14 17:51:52.467615 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: User-Agent: python-urllib3/1.26.9 Jul 14 17:51:52.467615 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Auth-Token: gAAAAABi0FeysZdaHIaaq-Lgiapua0UoiBpaJfVQcgaKAiRbVjxi6hxvtr7dcUaH8yNPVAasrTF82ttdMLAjAqVuCQPQP_oGJueydQXrj_7zGcO2hohtqD66I_fxBehCu6rgjp0lUPWSyDnFKasyNVann9Zmw8M_aWeBBWaQIr-sxZZH2nJF_n4 Jul 14 17:51:52.467615 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Id: None Jul 14 17:51:52.467615 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Name: None Jul 14 17:51:52.467615 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Identity-Status: Confirmed Jul 14 17:51:52.467615 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Is-Admin-Project: True Jul 14 17:51:52.467615 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Id: default Jul 14 17:51:52.467615 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Name: Default Jul 14 17:51:52.467615 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Id: ceae870c225d45cca6d22ed0f5b072fe Jul 14 17:51:52.467615 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Name: tempest-VolumesGetTestJSON-1108363255 Jul 14 17:51:52.467615 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Role: reader,member Jul 14 17:51:52.467615 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Roles: reader,member Jul 14 17:51:52.468958 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ceae870c225d45cca6d22ed0f5b072fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ceae870c225d45cca6d22ed0f5b072fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ceae870c225d45cca6d22ed0f5b072fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ceae870c225d45cca6d22ed0f5b072fe", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 17:51:52.468958 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant: tempest-VolumesGetTestJSON-1108363255 Jul 14 17:51:52.468958 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Id: ceae870c225d45cca6d22ed0f5b072fe Jul 14 17:51:52.468958 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Name: tempest-VolumesGetTestJSON-1108363255 Jul 14 17:51:52.468958 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User: tempest-VolumesGetTestJSON-1108363255-project Jul 14 17:51:52.468958 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Id: default Jul 14 17:51:52.468958 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Name: Default Jul 14 17:51:52.468958 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Id: d0d3f805c35448a194bba74d75ba2d14 Jul 14 17:51:52.468958 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Name: tempest-VolumesGetTestJSON-1108363255-project Jul 14 17:51:52.468958 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: method: Jul 14 17:51:52.468958 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: exception: Volume ff17b090-5761-43ec-9a0b-6c11de385e06 could not be found. Jul 14 17:51:52.468958 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: action_args: {'id': 'ff17b090-5761-43ec-9a0b-6c11de385e06'} Jul 14 17:51:52.468958 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 17:51:52.469560 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:51:52.469560 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 17:51:52.469560 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 17:51:52.469560 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 17:51:52.469560 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 17:51:52.469560 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 17:51:52.469560 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 17:51:52.469560 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 17:51:52.469560 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 17:51:52.469560 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 17:51:52.469560 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 17:51:52.469560 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 17:51:52.469560 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 17:51:52.469560 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 17:51:52.469560 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 17:51:52.469560 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ff17b090-5761-43ec-9a0b-6c11de385e06 could not be found. (HTTP 404) (Request-ID: req-99221085-acca-4e40-b31e-620bc9330288) Jul 14 17:51:52.469560 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 17:51:52.469560 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:51:52.469560 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 17:51:52.470552 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:51:52.470552 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 17:51:52.470552 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 17:51:52.470552 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 17:51:52.470552 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 17:51:52.470552 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 17:51:52.470552 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 17:51:52.470552 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 17:51:52.470552 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 17:51:52.470552 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 17:51:52.470552 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 17:51:52.470552 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 17:51:52.470552 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 17:51:52.470552 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 17:51:52.470552 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 17:51:52.470552 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 17:51:52.470552 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 17:51:52.470552 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 17:51:52.470552 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 17:51:52.471391 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 17:51:52.471391 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 17:51:52.471391 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 17:51:52.471391 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 17:51:52.471391 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ff17b090-5761-43ec-9a0b-6c11de385e06 could not be found. Jul 14 17:51:52.471391 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 17:51:52.471391 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:51:52.471391 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 17:51:52.471391 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:51:52.471391 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:51:52.471391 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:51:52.471391 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 17:51:52.471391 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 17:51:52.471391 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 17:51:52.471391 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 17:51:52.471391 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 17:51:52.471391 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 17:51:52.471391 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 17:51:52.471391 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 17:51:52.472304 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ff17b090-5761-43ec-9a0b-6c11de385e06 could not be found. Jul 14 17:51:52.472304 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 17:51:52.472304 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:51:52.472304 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 17:51:52.472304 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:51:52.472304 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:51:52.472304 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:51:52.472304 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 17:51:52.472304 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 17:51:52.472304 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ff17b090-5761-43ec-9a0b-6c11de385e06 could not be found. Jul 14 17:51:52.472304 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 17:51:52.474840 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-be87be7f-6913-456d-baf7-88f33066cc9c tempest-VolumesGetTestJSON-1108363255 tempest-VolumesGetTestJSON-1108363255-project] Returning 404 to user: Volume ff17b090-5761-43ec-9a0b-6c11de385e06 could not be found. {{(pid=129470) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 17:51:52.475990 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-be87be7f-6913-456d-baf7-88f33066cc9c tempest-VolumesGetTestJSON-1108363255 tempest-VolumesGetTestJSON-1108363255-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/ff17b090-5761-43ec-9a0b-6c11de385e06" status: 404 len: 109 microversion: 2.1 time: 0.072004 Jul 14 17:51:52.476800 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 4/7] 10.222.0.64 () {58 vars in 1244 bytes} [Thu Jul 14 17:51:52 2022] GET /compute/v2.1/os-volumes/ff17b090-5761-43ec-9a0b-6c11de385e06 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 17:51:52.946283 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-8a733c3d-e6fb-4174-b354-efb990627d29 tempest-VolumesTestJSON-2018408631 tempest-VolumesTestJSON-2018408631-project] Calling method '.version_select at 0x7f138160f820>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:51:53.048359 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-8a733c3d-e6fb-4174-b354-efb990627d29 tempest-VolumesTestJSON-2018408631 tempest-VolumesTestJSON-2018408631-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/c5bfb0a3-6cf2-4936-8d6a-ee7a174dc376" status: 200 len: 350 microversion: 2.1 time: 0.107739 Jul 14 17:51:53.049658 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 4/8] 10.222.0.64 () {58 vars in 1244 bytes} [Thu Jul 14 17:51:52 2022] GET /compute/v2.1/os-volumes/c5bfb0a3-6cf2-4936-8d6a-ee7a174dc376 => generated 350 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:51:55.001766 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-dab1e0bd-6490-4ae1-a32b-bdf2bbe84c0b tempest-VolumesTestJSON-2018408631 tempest-VolumesTestJSON-2018408631-project] Calling method '.version_select at 0x7f13815843a0>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:51:55.094255 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-dab1e0bd-6490-4ae1-a32b-bdf2bbe84c0b tempest-VolumesTestJSON-2018408631 tempest-VolumesTestJSON-2018408631-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/b8dc2f12-dd78-40ac-af73-694c940c557f" status: 200 len: 350 microversion: 2.1 time: 0.096692 Jul 14 17:51:55.095666 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 5/9] 10.222.0.64 () {58 vars in 1244 bytes} [Thu Jul 14 17:51:54 2022] GET /compute/v2.1/os-volumes/b8dc2f12-dd78-40ac-af73-694c940c557f => generated 350 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:51:55.108093 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-7a763ad8-2932-451b-931b-744623f6ed6e tempest-VolumesTestJSON-2018408631 tempest-VolumesTestJSON-2018408631-project] Calling method '.version_select at 0x7f1381651d30>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:51:55.325973 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-7a763ad8-2932-451b-931b-744623f6ed6e tempest-VolumesTestJSON-2018408631 tempest-VolumesTestJSON-2018408631-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.222024 Jul 14 17:51:55.327072 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 5/10] 10.222.0.64 () {58 vars in 1133 bytes} [Thu Jul 14 17:51:55 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:51:55.343686 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-1e22af5a-93ed-48e9-a219-8258fc7addd0 tempest-VolumesTestJSON-2018408631 tempest-VolumesTestJSON-2018408631-project] Calling method '.version_select at 0x7f1381584a60>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:51:55.710125 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-1e22af5a-93ed-48e9-a219-8258fc7addd0 tempest-VolumesTestJSON-2018408631 tempest-VolumesTestJSON-2018408631-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.370366 Jul 14 17:51:55.719529 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 6/11] 10.222.0.64 () {58 vars in 1148 bytes} [Thu Jul 14 17:51:55 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:51:55.725136 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-fc477f3a-763c-43bc-bc02-e24c6fd61b4a tempest-VolumesTestJSON-2018408631 tempest-VolumesTestJSON-2018408631-project] Calling method '.version_select at 0x7f138160f670>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:51:55.910710 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-fc477f3a-763c-43bc-bc02-e24c6fd61b4a tempest-VolumesTestJSON-2018408631 tempest-VolumesTestJSON-2018408631-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.189150 Jul 14 17:51:55.912686 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 6/12] 10.222.0.64 () {58 vars in 1133 bytes} [Thu Jul 14 17:51:55 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:51:55.927346 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-d62c16b5-111b-41f4-9e06-5f41acdfc527 tempest-VolumesTestJSON-2018408631 tempest-VolumesTestJSON-2018408631-project] Calling method '.version_select at 0x7f1381584dc0>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:51:56.089513 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-d62c16b5-111b-41f4-9e06-5f41acdfc527 tempest-VolumesTestJSON-2018408631 tempest-VolumesTestJSON-2018408631-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.170430 Jul 14 17:51:56.090609 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 7/13] 10.222.0.64 () {58 vars in 1166 bytes} [Thu Jul 14 17:51:55 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 17:51:56.109991 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-391a33d1-48e3-44ad-8f3c-0f0aa6bd8c95 tempest-VolumesTestJSON-2018408631 tempest-VolumesTestJSON-2018408631-project] Calling method '.version_select at 0x7f138160fdc0>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:51:56.305981 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-391a33d1-48e3-44ad-8f3c-0f0aa6bd8c95 tempest-VolumesTestJSON-2018408631 tempest-VolumesTestJSON-2018408631-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.205162 Jul 14 17:51:56.307512 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 7/14] 10.222.0.64 () {58 vars in 1169 bytes} [Thu Jul 14 17:51:56 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:51:56.321639 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-5427c794-8097-4233-b74f-1ba50e108d02 tempest-VolumesTestJSON-2018408631 tempest-VolumesTestJSON-2018408631-project] Calling method '.version_select at 0x7f138158b0d0>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:51:56.548502 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-5427c794-8097-4233-b74f-1ba50e108d02 tempest-VolumesTestJSON-2018408631 tempest-VolumesTestJSON-2018408631-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.231099 Jul 14 17:51:56.550687 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 8/15] 10.222.0.64 () {58 vars in 1154 bytes} [Thu Jul 14 17:51:56 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:51:56.563158 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-c495eafd-1667-48ba-bcfc-014d487fd291 tempest-VolumesTestJSON-2018408631 tempest-VolumesTestJSON-2018408631-project] Calling method '.version_select at 0x7f1381f9f160>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:51:56.744334 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-c495eafd-1667-48ba-bcfc-014d487fd291 tempest-VolumesTestJSON-2018408631 tempest-VolumesTestJSON-2018408631-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.187199 Jul 14 17:51:56.744983 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 8/16] 10.222.0.64 () {58 vars in 1187 bytes} [Thu Jul 14 17:51:56 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:51:56.759228 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-9707c373-0275-4dce-8314-61f9f17f472a tempest-VolumesTestJSON-2018408631 tempest-VolumesTestJSON-2018408631-project] Calling method '.version_select at 0x7f138158bd30>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:51:57.017830 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-9707c373-0275-4dce-8314-61f9f17f472a tempest-VolumesTestJSON-2018408631 tempest-VolumesTestJSON-2018408631-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.263586 Jul 14 17:51:57.018405 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 9/17] 10.222.0.64 () {58 vars in 1154 bytes} [Thu Jul 14 17:51:56 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:51:59.316164 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-89abcc6f-1af7-46f3-8079-a815c43cfa36 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1808311339", "imageRef": "cf1f5d8c-9e49-4272-8e19-8e3c587056e1", "flavorRef": "452", "networks": [{"uuid": "83d0820e-2f8b-4b85-b763-191f155b87fc"}]}} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:51:59.613732 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.network.neutron [None req-89abcc6f-1af7-46f3-8079-a815c43cfa36 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] validate_networks() for [('83d0820e-2f8b-4b85-b763-191f155b87fc', None, None, None, None, None)] {{(pid=129471) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 17:52:03.148842 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-89abcc6f-1af7-46f3-8079-a815c43cfa36 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Flavor limits 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 17:52:03.150560 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-89abcc6f-1af7-46f3-8079-a815c43cfa36 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Image limits 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 17:52:03.151374 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-89abcc6f-1af7-46f3-8079-a815c43cfa36 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Flavor pref 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 17:52:03.152213 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-89abcc6f-1af7-46f3-8079-a815c43cfa36 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Image pref 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 17:52:03.153181 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-89abcc6f-1af7-46f3-8079-a815c43cfa36 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 17:52:03.208634 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-89abcc6f-1af7-46f3-8079-a815c43cfa36 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:03.217620 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-89abcc6f-1af7-46f3-8079-a815c43cfa36 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:03.219509 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-89abcc6f-1af7-46f3-8079-a815c43cfa36 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:03.221110 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-89abcc6f-1af7-46f3-8079-a815c43cfa36 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:03.367376 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.quota [None req-89abcc6f-1af7-46f3-8079-a815c43cfa36 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Getting quotas for project 65ba80b0874640d289c54ad4ac5a1018. Resources: {'ram', 'cores', 'instances'} {{(pid=129471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 17:52:03.393799 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.quota [None req-89abcc6f-1af7-46f3-8079-a815c43cfa36 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Getting quotas for user be1201ac0aa7484f96e271410342a6b9 and project 65ba80b0874640d289c54ad4ac5a1018. Resources: {'ram', 'cores', 'instances'} {{(pid=129471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 17:52:03.440490 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-89abcc6f-1af7-46f3-8079-a815c43cfa36 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Going to run 1 instances... {{(pid=129471) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 17:52:03.450407 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-89abcc6f-1af7-46f3-8079-a815c43cfa36 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf1f5d8c-9e49-4272-8e19-8e3c587056e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 17:52:03.639698 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-89abcc6f-1af7-46f3-8079-a815c43cfa36 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.021887 Jul 14 17:52:03.640547 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 9/18] 10.222.0.64 () {60 vars in 1146 bytes} [Thu Jul 14 17:51:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 5024 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 17:52:03.650784 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-c2a33fa4-e54e-4c66-aade-5efa8b1c2fb1 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:03.651513 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-c2a33fa4-e54e-4c66-aade-5efa8b1c2fb1 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:03.946964 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-c2a33fa4-e54e-4c66-aade-5efa8b1c2fb1 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:03.968636 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-c2a33fa4-e54e-4c66-aade-5efa8b1c2fb1 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1215 microversion: 2.1 time: 0.321541 Jul 14 17:52:03.979283 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 10/19] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:03 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1215 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:04.988003 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-3d4170b8-b152-47cd-8a3c-63d799aca541 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:04.990220 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-3d4170b8-b152-47cd-8a3c-63d799aca541 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:05.101771 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-3d4170b8-b152-47cd-8a3c-63d799aca541 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:05.112562 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-3d4170b8-b152-47cd-8a3c-63d799aca541 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1215 microversion: 2.1 time: 0.128940 Jul 14 17:52:05.127550 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 11/20] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:04 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1215 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:05.688842 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-692694c4-e61a-48ad-99c3-dd08fb19d650 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Action: 'create', calling method: .version_select at 0x7f13815274c0>, body: {"keypair": {"name": "tempest-keypair-319288908", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOm3UaE+UffvD5YEIlKAaPqxwJuXceB9+w09U3QdBHuDTDuQfh1WZB88bjhJvexBE4IhM9Blftfyy4SWgzvTyssiDOJRzXvZHztgwLMccuknj1+aAdACzdDxmk1JcgTZw=="}} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:52:05.796505 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.quota [None req-692694c4-e61a-48ad-99c3-dd08fb19d650 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Getting quotas for project 69d2b6a5a4534cadb34e626ce33238df. Resources: {'key_pairs'} {{(pid=129471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 17:52:05.818252 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.quota [None req-692694c4-e61a-48ad-99c3-dd08fb19d650 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Getting quotas for user c4178d34dc114f46af725c9dc362d224 and project 69d2b6a5a4534cadb34e626ce33238df. Resources: {'key_pairs'} {{(pid=129471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 17:52:05.940327 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-692694c4-e61a-48ad-99c3-dd08fb19d650 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.051044 Jul 14 17:52:05.941857 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 10/21] 10.222.0.64 () {62 vars in 1199 bytes} [Thu Jul 14 17:52:04 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1053 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 14 17:52:06.136029 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-3d2e7249-5ea7-483f-b2d1-9e66d0a279b3 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:06.137837 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-3d2e7249-5ea7-483f-b2d1-9e66d0a279b3 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:06.161725 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3d2e7249-5ea7-483f-b2d1-9e66d0a279b3 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:06.166105 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3d2e7249-5ea7-483f-b2d1-9e66d0a279b3 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:06.180603 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3d2e7249-5ea7-483f-b2d1-9e66d0a279b3 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:06.181597 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3d2e7249-5ea7-483f-b2d1-9e66d0a279b3 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:06.772779 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-3d2e7249-5ea7-483f-b2d1-9e66d0a279b3 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:06.818290 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-3d2e7249-5ea7-483f-b2d1-9e66d0a279b3 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1219 microversion: 2.1 time: 0.686798 Jul 14 17:52:06.819116 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 12/22] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:06 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1219 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:07.840404 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-3ef6e45b-e93a-4a2f-9bd6-24cb6dfe8e66 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:07.841312 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-3ef6e45b-e93a-4a2f-9bd6-24cb6dfe8e66 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:07.911513 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3ef6e45b-e93a-4a2f-9bd6-24cb6dfe8e66 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:07.912338 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3ef6e45b-e93a-4a2f-9bd6-24cb6dfe8e66 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:07.916335 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3ef6e45b-e93a-4a2f-9bd6-24cb6dfe8e66 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:07.918188 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3ef6e45b-e93a-4a2f-9bd6-24cb6dfe8e66 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:08.324645 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-3ef6e45b-e93a-4a2f-9bd6-24cb6dfe8e66 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:08.355086 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-3ef6e45b-e93a-4a2f-9bd6-24cb6dfe8e66 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1285 microversion: 2.1 time: 0.520653 Jul 14 17:52:08.364108 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 11/23] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:07 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1285 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:08.586374 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-fd8dda32-a2a6-4599-b8a8-545833a619d5 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Action: 'create', calling method: .version_select at 0x7f13814d03a0>, body: {"keypair": {"name": "tempest-keypair-1892899044", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPElbYr5JET0m3Lzk6Wg/DZcWbKAYrLblVJA7OFTvCXDg6CParNu35t7R+bLYOa5rB7W//dbboPLoaGEW8MN3e4Sebpy9ouPi96zI+gbMRSURzUnrJW2fGuq3kmcNRCmXA=="}} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:52:08.692961 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.quota [None req-fd8dda32-a2a6-4599-b8a8-545833a619d5 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Getting quotas for project e51408d5653d460f82009b65e238281f. Resources: {'key_pairs'} {{(pid=129470) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 17:52:08.711665 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.quota [None req-fd8dda32-a2a6-4599-b8a8-545833a619d5 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Getting quotas for user 84c38f6ff5af4ba79c80fb581baacb0b and project e51408d5653d460f82009b65e238281f. Resources: {'key_pairs'} {{(pid=129470) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 17:52:08.829483 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-fd8dda32-a2a6-4599-b8a8-545833a619d5 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.908880 Jul 14 17:52:08.831124 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 13/24] 10.222.0.64 () {60 vars in 1158 bytes} [Thu Jul 14 17:52:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:52:09.379225 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-66852182-3255-4f91-b4eb-4b5d27f1f50b tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:09.379886 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-66852182-3255-4f91-b4eb-4b5d27f1f50b tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:09.394729 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-66852182-3255-4f91-b4eb-4b5d27f1f50b tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:09.395213 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-66852182-3255-4f91-b4eb-4b5d27f1f50b tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:09.399332 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-66852182-3255-4f91-b4eb-4b5d27f1f50b tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:09.399885 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-66852182-3255-4f91-b4eb-4b5d27f1f50b tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:09.661971 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-66852182-3255-4f91-b4eb-4b5d27f1f50b tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:09.677956 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-66852182-3255-4f91-b4eb-4b5d27f1f50b tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1273 microversion: 2.1 time: 0.304946 Jul 14 17:52:09.680210 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 12/25] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:09 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1273 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:10.699515 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-24cdd92e-28a6-4044-a541-1afa6f4d7361 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:10.700421 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-24cdd92e-28a6-4044-a541-1afa6f4d7361 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:10.733115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-24cdd92e-28a6-4044-a541-1afa6f4d7361 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:10.733115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-24cdd92e-28a6-4044-a541-1afa6f4d7361 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:10.744148 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-24cdd92e-28a6-4044-a541-1afa6f4d7361 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:10.744798 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-24cdd92e-28a6-4044-a541-1afa6f4d7361 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:11.277589 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-24cdd92e-28a6-4044-a541-1afa6f4d7361 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:11.285597 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-24cdd92e-28a6-4044-a541-1afa6f4d7361 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1273 microversion: 2.1 time: 0.591249 Jul 14 17:52:11.305254 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 14/26] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:10 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1273 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:12.307770 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-920acbcd-678a-4936-b926-35cf8df037c8 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:12.308492 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-920acbcd-678a-4936-b926-35cf8df037c8 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:12.324182 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-920acbcd-678a-4936-b926-35cf8df037c8 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:12.324445 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-920acbcd-678a-4936-b926-35cf8df037c8 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:12.325287 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-920acbcd-678a-4936-b926-35cf8df037c8 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:12.325725 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-920acbcd-678a-4936-b926-35cf8df037c8 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:13.018076 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-920acbcd-678a-4936-b926-35cf8df037c8 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:13.039236 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-920acbcd-678a-4936-b926-35cf8df037c8 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1315 microversion: 2.1 time: 0.733365 Jul 14 17:52:13.044016 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 13/27] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:12 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1315 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:13.794061 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-2aac8b30-c129-43f9-bad4-2a5328cda327 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-967688506", "imageRef": "cf1f5d8c-9e49-4272-8e19-8e3c587056e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:52:13.981230 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.network.neutron [None req-2aac8b30-c129-43f9-bad4-2a5328cda327 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] validate_networks() for [('f0a7a3b8-c0d5-44f2-8b6f-863a45d618db', None, None, None, None, None)] {{(pid=129470) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 17:52:14.059068 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-99c70a91-fb1c-41a5-83f3-651536de67ab tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:14.060551 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-99c70a91-fb1c-41a5-83f3-651536de67ab tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:14.072809 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell0:SELECT=2 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:52:14.089467 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-99c70a91-fb1c-41a5-83f3-651536de67ab tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:14.089975 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-99c70a91-fb1c-41a5-83f3-651536de67ab tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:14.090817 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-99c70a91-fb1c-41a5-83f3-651536de67ab tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:14.097341 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-99c70a91-fb1c-41a5-83f3-651536de67ab tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:15.293080 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-99c70a91-fb1c-41a5-83f3-651536de67ab tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:15.322248 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-99c70a91-fb1c-41a5-83f3-651536de67ab tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1315 microversion: 2.1 time: 1.252461 Jul 14 17:52:15.322852 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 14/28] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:14 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1315 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:52:15.764777 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-b16fc181-5658-4bc8-9cbf-eef88e870107 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-967997464", "imageRef": "cf1f5d8c-9e49-4272-8e19-8e3c587056e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c730473d-7caa-417d-8844-88c6549d7fd2"}], "security_groups": [{"name": "tempest-securitygroup--755534270"}], "key_name": "tempest-keypair-1892899044", "user_data": "}} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:52:15.856055 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell0:SELECT=10 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:52:16.271221 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.network.neutron [None req-b16fc181-5658-4bc8-9cbf-eef88e870107 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] validate_networks() for [('c730473d-7caa-417d-8844-88c6549d7fd2', None, None, None, None, None)] {{(pid=129471) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 17:52:18.029158 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-2aac8b30-c129-43f9-bad4-2a5328cda327 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Flavor limits 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 17:52:18.029681 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-2aac8b30-c129-43f9-bad4-2a5328cda327 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Image limits 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 17:52:18.030219 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-2aac8b30-c129-43f9-bad4-2a5328cda327 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Flavor pref 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 17:52:18.030650 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-2aac8b30-c129-43f9-bad4-2a5328cda327 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Image pref 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 17:52:18.031073 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-2aac8b30-c129-43f9-bad4-2a5328cda327 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 17:52:18.049630 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2aac8b30-c129-43f9-bad4-2a5328cda327 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:18.050078 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2aac8b30-c129-43f9-bad4-2a5328cda327 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:18.071648 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2aac8b30-c129-43f9-bad4-2a5328cda327 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:18.072395 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2aac8b30-c129-43f9-bad4-2a5328cda327 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:18.146883 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.quota [None req-2aac8b30-c129-43f9-bad4-2a5328cda327 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Getting quotas for project ab58d5c4c0194b58ad47dd5e4494389f. Resources: {'ram', 'cores', 'instances'} {{(pid=129470) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 17:52:18.170442 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.quota [None req-2aac8b30-c129-43f9-bad4-2a5328cda327 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Getting quotas for user 52c794c11ab74f9ca9bad75857043a62 and project ab58d5c4c0194b58ad47dd5e4494389f. Resources: {'ram', 'cores', 'instances'} {{(pid=129470) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 17:52:18.209258 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-b16fc181-5658-4bc8-9cbf-eef88e870107 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Flavor limits 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 17:52:18.210314 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-b16fc181-5658-4bc8-9cbf-eef88e870107 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Image limits 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 17:52:18.211522 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-b16fc181-5658-4bc8-9cbf-eef88e870107 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Flavor pref 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 17:52:18.212157 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-b16fc181-5658-4bc8-9cbf-eef88e870107 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Image pref 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 17:52:18.213174 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-b16fc181-5658-4bc8-9cbf-eef88e870107 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 17:52:18.240295 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b16fc181-5658-4bc8-9cbf-eef88e870107 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:18.248667 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b16fc181-5658-4bc8-9cbf-eef88e870107 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:18.250233 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-2aac8b30-c129-43f9-bad4-2a5328cda327 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Going to run 1 instances... {{(pid=129470) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 17:52:18.251394 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b16fc181-5658-4bc8-9cbf-eef88e870107 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:18.254713 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-2aac8b30-c129-43f9-bad4-2a5328cda327 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf1f5d8c-9e49-4272-8e19-8e3c587056e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129470) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 17:52:18.255617 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b16fc181-5658-4bc8-9cbf-eef88e870107 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:18.364930 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.quota [None req-b16fc181-5658-4bc8-9cbf-eef88e870107 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Getting quotas for project e51408d5653d460f82009b65e238281f. Resources: {'ram', 'cores', 'instances'} {{(pid=129471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 17:52:18.384582 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.quota [None req-b16fc181-5658-4bc8-9cbf-eef88e870107 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Getting quotas for user 84c38f6ff5af4ba79c80fb581baacb0b and project e51408d5653d460f82009b65e238281f. Resources: {'ram', 'cores', 'instances'} {{(pid=129471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 17:52:18.430515 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-b16fc181-5658-4bc8-9cbf-eef88e870107 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Going to run 1 instances... {{(pid=129471) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 17:52:18.452075 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-b16fc181-5658-4bc8-9cbf-eef88e870107 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf1f5d8c-9e49-4272-8e19-8e3c587056e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 17:52:18.537379 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-2aac8b30-c129-43f9-bad4-2a5328cda327 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.009336 Jul 14 17:52:18.539533 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 15/29] 10.222.0.64 () {60 vars in 1146 bytes} [Thu Jul 14 17:52:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 6013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 17:52:18.549745 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-638060d2-e171-4028-80aa-088d12116559 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:18.551182 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-638060d2-e171-4028-80aa-088d12116559 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:18.590643 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-638060d2-e171-4028-80aa-088d12116559 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:18.603753 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-638060d2-e171-4028-80aa-088d12116559 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:18.604792 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-638060d2-e171-4028-80aa-088d12116559 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:18.605261 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-638060d2-e171-4028-80aa-088d12116559 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:18.657793 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-b16fc181-5658-4bc8-9cbf-eef88e870107 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.902435 Jul 14 17:52:18.664892 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 15/30] 10.222.0.64 () {60 vars in 1146 bytes} [Thu Jul 14 17:52:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 2910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 17:52:18.698278 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-c38eaec5-8aea-4116-b766-0a61ed0d1474 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1698264359", "imageRef": "cf1f5d8c-9e49-4272-8e19-8e3c587056e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7ce47168-d219-4fd4-9c00-8868df258117"}], "security_groups": [{"name": "tempest-securitygroup--1498131668"}], "key_name": "tempest-keypair-319288908", "user_data": "}} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:52:19.262356 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.network.neutron [None req-c38eaec5-8aea-4116-b766-0a61ed0d1474 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] validate_networks() for [('7ce47168-d219-4fd4-9c00-8868df258117', None, None, None, None, None)] {{(pid=129471) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 17:52:19.267544 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-638060d2-e171-4028-80aa-088d12116559 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:19.279313 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-638060d2-e171-4028-80aa-088d12116559 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1315 microversion: 2.1 time: 0.738122 Jul 14 17:52:19.284990 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 16/31] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:18 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1315 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:19.298136 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-0adbf3b1-ffb7-4083-98bb-bba07d5783a4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:19.299315 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-0adbf3b1-ffb7-4083-98bb-bba07d5783a4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:19.669408 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-0adbf3b1-ffb7-4083-98bb-bba07d5783a4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:19.701468 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-0adbf3b1-ffb7-4083-98bb-bba07d5783a4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1221 microversion: 2.1 time: 0.412485 Jul 14 17:52:19.722764 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 17/32] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:19 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1221 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:19.760790 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-72403dfb-fbe3-4f0e-90cd-4638528d3234 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:19.762552 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-72403dfb-fbe3-4f0e-90cd-4638528d3234 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:20.222930 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-72403dfb-fbe3-4f0e-90cd-4638528d3234 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:20.231444 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-72403dfb-fbe3-4f0e-90cd-4638528d3234 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1237 microversion: 2.1 time: 0.504970 Jul 14 17:52:20.237398 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 18/33] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:19 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1237 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:20.772048 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-000cb551-f4de-42bc-bb30-87f63ede224c req-c47a727f-08c3-4299-beb5-c7ed27db9d10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "694a2002-80ed-4200-ad1e-83f4471de34b", "tag": "35a6a884-f267-4330-b918-3243a1a07498"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:52:20.808267 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-000cb551-f4de-42bc-bb30-87f63ede224c req-c47a727f-08c3-4299-beb5-c7ed27db9d10 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:20.814194 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-000cb551-f4de-42bc-bb30-87f63ede224c req-c47a727f-08c3-4299-beb5-c7ed27db9d10 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:20.841115 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-c38eaec5-8aea-4116-b766-0a61ed0d1474 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Flavor limits 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 17:52:20.842359 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-c38eaec5-8aea-4116-b766-0a61ed0d1474 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Image limits 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 17:52:20.843230 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-c38eaec5-8aea-4116-b766-0a61ed0d1474 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Flavor pref 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 17:52:20.843860 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-c38eaec5-8aea-4116-b766-0a61ed0d1474 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Image pref 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 17:52:20.845055 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-c38eaec5-8aea-4116-b766-0a61ed0d1474 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 17:52:20.851795 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=7 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:52:20.879893 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c38eaec5-8aea-4116-b766-0a61ed0d1474 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:20.891668 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c38eaec5-8aea-4116-b766-0a61ed0d1474 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:20.894583 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c38eaec5-8aea-4116-b766-0a61ed0d1474 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:20.896642 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c38eaec5-8aea-4116-b766-0a61ed0d1474 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:20.919080 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-000cb551-f4de-42bc-bb30-87f63ede224c req-c47a727f-08c3-4299-beb5-c7ed27db9d10 service nova] Creating event network-changed:35a6a884-f267-4330-b918-3243a1a07498 for instance 694a2002-80ed-4200-ad1e-83f4471de34b on hv-cinder-84989 Jul 14 17:52:20.924404 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-000cb551-f4de-42bc-bb30-87f63ede224c req-c47a727f-08c3-4299-beb5-c7ed27db9d10 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129470) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 17:52:20.930401 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-93797b00-6ef4-4aec-9541-543d034e3f12 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:20.935090 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-93797b00-6ef4-4aec-9541-543d034e3f12 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:20.942627 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-93797b00-6ef4-4aec-9541-543d034e3f12 None None] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:20.943368 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-93797b00-6ef4-4aec-9541-543d034e3f12 None None] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:20.979700 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.quota [None req-c38eaec5-8aea-4116-b766-0a61ed0d1474 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Getting quotas for project 69d2b6a5a4534cadb34e626ce33238df. Resources: {'ram', 'cores', 'instances'} {{(pid=129471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 17:52:20.990658 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.compute.rpcapi [None req-93797b00-6ef4-4aec-9541-543d034e3f12 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 14 17:52:20.991569 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.quota [None req-c38eaec5-8aea-4116-b766-0a61ed0d1474 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Getting quotas for user c4178d34dc114f46af725c9dc362d224 and project 69d2b6a5a4534cadb34e626ce33238df. Resources: {'ram', 'cores', 'instances'} {{(pid=129471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 17:52:20.995750 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-93797b00-6ef4-4aec-9541-543d034e3f12 None None] Releasing lock "compute-rpcapi-router" {{(pid=129470) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 17:52:21.032138 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-c38eaec5-8aea-4116-b766-0a61ed0d1474 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Going to run 1 instances... {{(pid=129471) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 17:52:21.039849 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-c38eaec5-8aea-4116-b766-0a61ed0d1474 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf1f5d8c-9e49-4272-8e19-8e3c587056e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 17:52:21.052367 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-93797b00-6ef4-4aec-9541-543d034e3f12 None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.811522 Jul 14 17:52:21.057359 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 19/34] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 17:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:52:21.085769 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-2d69d1f8-8d16-4312-ae2b-7d7bbe060335 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1595878403", "imageRef": "cf1f5d8c-9e49-4272-8e19-8e3c587056e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:52:21.205760 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-c38eaec5-8aea-4116-b766-0a61ed0d1474 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.533701 Jul 14 17:52:21.212578 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 16/35] 10.222.0.64 () {62 vars in 1187 bytes} [Thu Jul 14 17:52:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 2542 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 17:52:21.218413 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-1981bf78-371e-46a2-a26c-f172243cb65d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:21.219253 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-1981bf78-371e-46a2-a26c-f172243cb65d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:21.227999 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1981bf78-371e-46a2-a26c-f172243cb65d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:21.228711 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1981bf78-371e-46a2-a26c-f172243cb65d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:21.229669 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1981bf78-371e-46a2-a26c-f172243cb65d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:21.230276 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1981bf78-371e-46a2-a26c-f172243cb65d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:21.270707 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.network.neutron [None req-2d69d1f8-8d16-4312-ae2b-7d7bbe060335 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] validate_networks() for [('f0a7a3b8-c0d5-44f2-8b6f-863a45d618db', None, None, None, None, None)] {{(pid=129470) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 17:52:22.343354 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-1981bf78-371e-46a2-a26c-f172243cb65d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:22.373077 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-1981bf78-371e-46a2-a26c-f172243cb65d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1315 microversion: 2.1 time: 1.156594 Jul 14 17:52:22.373716 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 17/36] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:21 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1315 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:22.396974 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-cd5af895-0a81-4fe9-949e-a2f3bb57e4d6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:22.399100 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-cd5af895-0a81-4fe9-949e-a2f3bb57e4d6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:22.413047 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-cd5af895-0a81-4fe9-949e-a2f3bb57e4d6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:22.413503 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-cd5af895-0a81-4fe9-949e-a2f3bb57e4d6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:22.417320 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-cd5af895-0a81-4fe9-949e-a2f3bb57e4d6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:22.419555 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-cd5af895-0a81-4fe9-949e-a2f3bb57e4d6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:22.989487 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-cd5af895-0a81-4fe9-949e-a2f3bb57e4d6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:23.007138 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-cd5af895-0a81-4fe9-949e-a2f3bb57e4d6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:23.020500 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-cd5af895-0a81-4fe9-949e-a2f3bb57e4d6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:23.025451 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-cd5af895-0a81-4fe9-949e-a2f3bb57e4d6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1285 microversion: 2.20 time: 0.643585 Jul 14 17:52:23.028968 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 18/37] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:52:22 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1285 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:52:23.049391 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-b16bb141-947c-4365-9eff-655a81448df3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:23.050207 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-b16bb141-947c-4365-9eff-655a81448df3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:23.066982 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b16bb141-947c-4365-9eff-655a81448df3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:23.067243 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b16bb141-947c-4365-9eff-655a81448df3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:23.077784 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b16bb141-947c-4365-9eff-655a81448df3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:23.078416 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b16bb141-947c-4365-9eff-655a81448df3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:23.322092 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-b16bb141-947c-4365-9eff-655a81448df3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:23.332657 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-b16bb141-947c-4365-9eff-655a81448df3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1295 microversion: 2.1 time: 0.300094 Jul 14 17:52:23.333297 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 19/38] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:23 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1295 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:23.390425 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-956f9c31-5457-4c34-a63a-a4963c9f55fe tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:23.391044 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-956f9c31-5457-4c34-a63a-a4963c9f55fe tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:23.402044 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-956f9c31-5457-4c34-a63a-a4963c9f55fe tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:23.402504 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-956f9c31-5457-4c34-a63a-a4963c9f55fe tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:23.405765 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-956f9c31-5457-4c34-a63a-a4963c9f55fe tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:23.405765 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-956f9c31-5457-4c34-a63a-a4963c9f55fe tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:23.680682 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-2d69d1f8-8d16-4312-ae2b-7d7bbe060335 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Flavor limits 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 17:52:23.681243 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-2d69d1f8-8d16-4312-ae2b-7d7bbe060335 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Image limits 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 17:52:23.681709 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-2d69d1f8-8d16-4312-ae2b-7d7bbe060335 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Flavor pref 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 17:52:23.682192 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-2d69d1f8-8d16-4312-ae2b-7d7bbe060335 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Image pref 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 17:52:23.682617 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-2d69d1f8-8d16-4312-ae2b-7d7bbe060335 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 17:52:23.698396 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2d69d1f8-8d16-4312-ae2b-7d7bbe060335 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:23.699048 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2d69d1f8-8d16-4312-ae2b-7d7bbe060335 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:23.700032 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2d69d1f8-8d16-4312-ae2b-7d7bbe060335 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:23.704916 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2d69d1f8-8d16-4312-ae2b-7d7bbe060335 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:23.775747 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.quota [None req-2d69d1f8-8d16-4312-ae2b-7d7bbe060335 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Getting quotas for project ab58d5c4c0194b58ad47dd5e4494389f. Resources: {'ram', 'cores', 'instances'} {{(pid=129470) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 17:52:23.790810 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.quota [None req-2d69d1f8-8d16-4312-ae2b-7d7bbe060335 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Getting quotas for user 52c794c11ab74f9ca9bad75857043a62 and project ab58d5c4c0194b58ad47dd5e4494389f. Resources: {'ram', 'cores', 'instances'} {{(pid=129470) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 17:52:23.798438 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-956f9c31-5457-4c34-a63a-a4963c9f55fe tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:23.816632 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-956f9c31-5457-4c34-a63a-a4963c9f55fe tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1315 microversion: 2.1 time: 0.421621 Jul 14 17:52:23.827270 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-2d69d1f8-8d16-4312-ae2b-7d7bbe060335 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Going to run 1 instances... {{(pid=129470) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 17:52:23.828895 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 20/39] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:23 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1315 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:52:23.840521 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-2d69d1f8-8d16-4312-ae2b-7d7bbe060335 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf1f5d8c-9e49-4272-8e19-8e3c587056e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129470) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 17:52:23.935352 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-2d69d1f8-8d16-4312-ae2b-7d7bbe060335 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.875039 Jul 14 17:52:23.939644 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 20/40] 10.222.0.64 () {60 vars in 1146 bytes} [Thu Jul 14 17:52:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 2881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 17:52:23.957284 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-20ecb011-2298-4c7f-9726-85450342722c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:23.957284 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-20ecb011-2298-4c7f-9726-85450342722c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:24.052006 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-97f6a920-7d58-4796-8a9c-4c3aec2ee633 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:24.052931 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-97f6a920-7d58-4796-8a9c-4c3aec2ee633 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:24.068097 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-97f6a920-7d58-4796-8a9c-4c3aec2ee633 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:24.068813 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-97f6a920-7d58-4796-8a9c-4c3aec2ee633 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:24.069402 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-20ecb011-2298-4c7f-9726-85450342722c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:24.069884 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-97f6a920-7d58-4796-8a9c-4c3aec2ee633 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:24.072262 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-97f6a920-7d58-4796-8a9c-4c3aec2ee633 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:24.090059 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-20ecb011-2298-4c7f-9726-85450342722c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1222 microversion: 2.1 time: 0.143679 Jul 14 17:52:24.091755 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 21/41] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:23 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1222 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:24.323338 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-97f6a920-7d58-4796-8a9c-4c3aec2ee633 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:24.337935 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-97f6a920-7d58-4796-8a9c-4c3aec2ee633 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:24.339160 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-97f6a920-7d58-4796-8a9c-4c3aec2ee633 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:24.340708 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-97f6a920-7d58-4796-8a9c-4c3aec2ee633 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1333 microversion: 2.20 time: 0.293516 Jul 14 17:52:24.351950 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-c1e717c5-aa55-4475-b8a1-6179c7a503f3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:24.352800 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-c1e717c5-aa55-4475-b8a1-6179c7a503f3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:24.356448 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 21/42] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:52:24 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1333 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:52:24.369712 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c1e717c5-aa55-4475-b8a1-6179c7a503f3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:24.375659 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c1e717c5-aa55-4475-b8a1-6179c7a503f3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:24.378098 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c1e717c5-aa55-4475-b8a1-6179c7a503f3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:24.378729 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c1e717c5-aa55-4475-b8a1-6179c7a503f3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:24.477598 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-c1e717c5-aa55-4475-b8a1-6179c7a503f3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:24.489416 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-c1e717c5-aa55-4475-b8a1-6179c7a503f3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1295 microversion: 2.1 time: 0.141166 Jul 14 17:52:24.494227 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 22/43] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:24 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1295 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:24.836173 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-a13a998d-3de8-4154-988d-32109d1003fe tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:24.836831 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-a13a998d-3de8-4154-988d-32109d1003fe tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:24.844258 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a13a998d-3de8-4154-988d-32109d1003fe tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:24.844636 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a13a998d-3de8-4154-988d-32109d1003fe tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:24.845480 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a13a998d-3de8-4154-988d-32109d1003fe tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:24.846030 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a13a998d-3de8-4154-988d-32109d1003fe tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:25.042027 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-a13a998d-3de8-4154-988d-32109d1003fe tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:25.051377 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-a13a998d-3de8-4154-988d-32109d1003fe tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1315 microversion: 2.1 time: 0.219601 Jul 14 17:52:25.060968 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 22/44] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:24 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:25.110587 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-5db3a0fb-e5de-446d-be84-36a6b682e129 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:25.110926 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-5db3a0fb-e5de-446d-be84-36a6b682e129 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:25.126873 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5db3a0fb-e5de-446d-be84-36a6b682e129 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:25.127447 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5db3a0fb-e5de-446d-be84-36a6b682e129 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:25.128165 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5db3a0fb-e5de-446d-be84-36a6b682e129 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:25.128618 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5db3a0fb-e5de-446d-be84-36a6b682e129 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:25.213448 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-5db3a0fb-e5de-446d-be84-36a6b682e129 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:25.226112 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-5db3a0fb-e5de-446d-be84-36a6b682e129 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1226 microversion: 2.1 time: 0.119594 Jul 14 17:52:25.227797 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 23/45] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:25 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1226 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:25.371966 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-76cad815-a592-46b8-afe1-cf66902f8bb7 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:25.372657 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-76cad815-a592-46b8-afe1-cf66902f8bb7 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:25.380687 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-76cad815-a592-46b8-afe1-cf66902f8bb7 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:25.381219 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-76cad815-a592-46b8-afe1-cf66902f8bb7 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:25.382084 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-76cad815-a592-46b8-afe1-cf66902f8bb7 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:25.382628 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-76cad815-a592-46b8-afe1-cf66902f8bb7 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:25.456529 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-76cad815-a592-46b8-afe1-cf66902f8bb7 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:25.466584 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-76cad815-a592-46b8-afe1-cf66902f8bb7 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:25.469410 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-76cad815-a592-46b8-afe1-cf66902f8bb7 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:25.472128 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-76cad815-a592-46b8-afe1-cf66902f8bb7 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1333 microversion: 2.20 time: 0.103055 Jul 14 17:52:25.472128 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 23/46] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:52:25 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1333 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:52:25.509135 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-7d63d12f-4712-4db4-b45f-eea829e5cdd3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:25.509756 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-7d63d12f-4712-4db4-b45f-eea829e5cdd3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:25.515694 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7d63d12f-4712-4db4-b45f-eea829e5cdd3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:25.516195 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7d63d12f-4712-4db4-b45f-eea829e5cdd3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:25.517070 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7d63d12f-4712-4db4-b45f-eea829e5cdd3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:25.517791 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7d63d12f-4712-4db4-b45f-eea829e5cdd3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:25.579824 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-7d63d12f-4712-4db4-b45f-eea829e5cdd3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:25.587943 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-7d63d12f-4712-4db4-b45f-eea829e5cdd3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1295 microversion: 2.1 time: 0.083636 Jul 14 17:52:25.588519 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 24/47] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:25 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1295 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:26.068703 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-d121ddca-fd49-4bcb-8702-a0e062a7fa62 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:26.069320 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-d121ddca-fd49-4bcb-8702-a0e062a7fa62 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:26.076161 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d121ddca-fd49-4bcb-8702-a0e062a7fa62 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:26.076619 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d121ddca-fd49-4bcb-8702-a0e062a7fa62 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:26.077390 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d121ddca-fd49-4bcb-8702-a0e062a7fa62 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:26.077832 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d121ddca-fd49-4bcb-8702-a0e062a7fa62 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:26.210553 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-d121ddca-fd49-4bcb-8702-a0e062a7fa62 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:26.218257 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-d121ddca-fd49-4bcb-8702-a0e062a7fa62 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1315 microversion: 2.1 time: 0.154058 Jul 14 17:52:26.218866 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 24/48] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:26 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:26.244252 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-030a8848-1a63-4c77-9a6d-370c6fd29927 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:26.244872 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-030a8848-1a63-4c77-9a6d-370c6fd29927 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:26.254185 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-030a8848-1a63-4c77-9a6d-370c6fd29927 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:26.254649 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-030a8848-1a63-4c77-9a6d-370c6fd29927 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:26.255429 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-030a8848-1a63-4c77-9a6d-370c6fd29927 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:26.255976 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-030a8848-1a63-4c77-9a6d-370c6fd29927 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:26.318976 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-030a8848-1a63-4c77-9a6d-370c6fd29927 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:26.327572 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-030a8848-1a63-4c77-9a6d-370c6fd29927 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1226 microversion: 2.1 time: 0.087066 Jul 14 17:52:26.337470 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 25/49] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:26 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:26.490125 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-318792e1-fda8-4595-a060-ed00d9e4a6bf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:26.490756 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-318792e1-fda8-4595-a060-ed00d9e4a6bf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:26.503406 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-318792e1-fda8-4595-a060-ed00d9e4a6bf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:26.507912 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-318792e1-fda8-4595-a060-ed00d9e4a6bf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:26.511194 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-318792e1-fda8-4595-a060-ed00d9e4a6bf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:26.511920 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-318792e1-fda8-4595-a060-ed00d9e4a6bf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:26.605936 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-902b6894-c36e-498d-89b9-f77a3ae31ed9 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:26.606537 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-902b6894-c36e-498d-89b9-f77a3ae31ed9 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:26.615111 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-902b6894-c36e-498d-89b9-f77a3ae31ed9 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:26.615571 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-902b6894-c36e-498d-89b9-f77a3ae31ed9 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:26.616389 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-902b6894-c36e-498d-89b9-f77a3ae31ed9 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:26.616830 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-902b6894-c36e-498d-89b9-f77a3ae31ed9 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:26.626650 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-318792e1-fda8-4595-a060-ed00d9e4a6bf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:26.636975 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-318792e1-fda8-4595-a060-ed00d9e4a6bf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:26.638885 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-318792e1-fda8-4595-a060-ed00d9e4a6bf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:26.640056 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-318792e1-fda8-4595-a060-ed00d9e4a6bf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1333 microversion: 2.20 time: 0.154371 Jul 14 17:52:26.648063 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 25/50] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:52:26 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1333 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:52:26.699073 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-902b6894-c36e-498d-89b9-f77a3ae31ed9 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:26.706641 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-902b6894-c36e-498d-89b9-f77a3ae31ed9 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1295 microversion: 2.1 time: 0.105798 Jul 14 17:52:26.708100 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 26/51] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:26 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1295 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:52:27.236672 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-8be423b6-95d4-479a-997d-452479bc19ec tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:27.237309 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-8be423b6-95d4-479a-997d-452479bc19ec tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:27.239287 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=7 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:52:27.245189 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8be423b6-95d4-479a-997d-452479bc19ec tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:27.245637 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8be423b6-95d4-479a-997d-452479bc19ec tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:27.246402 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8be423b6-95d4-479a-997d-452479bc19ec tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:27.246836 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8be423b6-95d4-479a-997d-452479bc19ec tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:27.251978 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=57 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:52:27.346053 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-0cc1eb60-6616-464f-b53e-c8d994da51f4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:27.346785 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-0cc1eb60-6616-464f-b53e-c8d994da51f4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:27.355314 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0cc1eb60-6616-464f-b53e-c8d994da51f4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:27.356252 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0cc1eb60-6616-464f-b53e-c8d994da51f4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:27.357607 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0cc1eb60-6616-464f-b53e-c8d994da51f4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:27.358459 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0cc1eb60-6616-464f-b53e-c8d994da51f4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:27.402677 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-8be423b6-95d4-479a-997d-452479bc19ec tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:27.410556 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-8be423b6-95d4-479a-997d-452479bc19ec tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1315 microversion: 2.1 time: 0.177604 Jul 14 17:52:27.411223 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 26/52] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:27 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:27.438760 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-0cc1eb60-6616-464f-b53e-c8d994da51f4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:27.446906 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-0cc1eb60-6616-464f-b53e-c8d994da51f4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1226 microversion: 2.1 time: 0.105219 Jul 14 17:52:27.447775 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 27/53] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:27 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1226 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:52:27.660421 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-d515e83b-4394-4730-a39b-f757c11570d5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:27.661024 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-d515e83b-4394-4730-a39b-f757c11570d5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:27.667728 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d515e83b-4394-4730-a39b-f757c11570d5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:27.668225 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d515e83b-4394-4730-a39b-f757c11570d5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:27.669010 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d515e83b-4394-4730-a39b-f757c11570d5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:27.669456 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d515e83b-4394-4730-a39b-f757c11570d5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:27.724411 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-85ee5d2d-0546-4c35-b9aa-ab4a0f16e242 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:27.725620 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-85ee5d2d-0546-4c35-b9aa-ab4a0f16e242 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:27.737422 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-85ee5d2d-0546-4c35-b9aa-ab4a0f16e242 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:27.737976 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-85ee5d2d-0546-4c35-b9aa-ab4a0f16e242 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:27.738943 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-85ee5d2d-0546-4c35-b9aa-ab4a0f16e242 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:27.739401 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-85ee5d2d-0546-4c35-b9aa-ab4a0f16e242 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:27.759081 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-d515e83b-4394-4730-a39b-f757c11570d5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:27.767871 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-d515e83b-4394-4730-a39b-f757c11570d5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:27.769560 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-d515e83b-4394-4730-a39b-f757c11570d5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:27.770936 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-d515e83b-4394-4730-a39b-f757c11570d5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1333 microversion: 2.20 time: 0.114479 Jul 14 17:52:27.771605 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 27/54] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:52:27 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1333 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:52:27.815654 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-85ee5d2d-0546-4c35-b9aa-ab4a0f16e242 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:27.824186 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-85ee5d2d-0546-4c35-b9aa-ab4a0f16e242 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1295 microversion: 2.1 time: 0.103719 Jul 14 17:52:27.824817 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 28/55] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:27 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1295 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:52:28.427489 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-fe61b399-1fd8-4f5f-98bc-8b1b8b6d0c09 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:28.428159 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-fe61b399-1fd8-4f5f-98bc-8b1b8b6d0c09 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:28.434253 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fe61b399-1fd8-4f5f-98bc-8b1b8b6d0c09 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:28.434706 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fe61b399-1fd8-4f5f-98bc-8b1b8b6d0c09 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:28.435471 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fe61b399-1fd8-4f5f-98bc-8b1b8b6d0c09 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:28.435906 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fe61b399-1fd8-4f5f-98bc-8b1b8b6d0c09 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:28.464193 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-86ef4a35-45b6-4edc-9f80-f3a4aa13a872 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:28.464805 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-86ef4a35-45b6-4edc-9f80-f3a4aa13a872 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:28.470710 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-86ef4a35-45b6-4edc-9f80-f3a4aa13a872 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:28.471339 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-86ef4a35-45b6-4edc-9f80-f3a4aa13a872 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:28.472323 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-86ef4a35-45b6-4edc-9f80-f3a4aa13a872 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:28.472965 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-86ef4a35-45b6-4edc-9f80-f3a4aa13a872 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:28.492369 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=100 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:52:28.556300 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-86ef4a35-45b6-4edc-9f80-f3a4aa13a872 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:28.566595 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-86ef4a35-45b6-4edc-9f80-f3a4aa13a872 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1226 microversion: 2.1 time: 0.106854 Jul 14 17:52:28.567176 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 29/56] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:28 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1226 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:52:28.605975 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-fe61b399-1fd8-4f5f-98bc-8b1b8b6d0c09 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:28.613593 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-fe61b399-1fd8-4f5f-98bc-8b1b8b6d0c09 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1315 microversion: 2.1 time: 0.189877 Jul 14 17:52:28.614589 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 28/57] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:28 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:28.789021 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-6d16f34b-777c-424e-8378-3e6ba3a1e7c3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:28.789606 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-6d16f34b-777c-424e-8378-3e6ba3a1e7c3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:28.795499 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6d16f34b-777c-424e-8378-3e6ba3a1e7c3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:28.796149 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6d16f34b-777c-424e-8378-3e6ba3a1e7c3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:28.797042 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6d16f34b-777c-424e-8378-3e6ba3a1e7c3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:28.797485 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6d16f34b-777c-424e-8378-3e6ba3a1e7c3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:28.843358 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-f0c8277a-26e8-4b24-932b-255549a8a9d5 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:28.843868 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-f0c8277a-26e8-4b24-932b-255549a8a9d5 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:28.850813 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f0c8277a-26e8-4b24-932b-255549a8a9d5 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:28.851266 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f0c8277a-26e8-4b24-932b-255549a8a9d5 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:28.852070 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f0c8277a-26e8-4b24-932b-255549a8a9d5 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:28.852513 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f0c8277a-26e8-4b24-932b-255549a8a9d5 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:28.861533 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-6d16f34b-777c-424e-8378-3e6ba3a1e7c3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:28.874542 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-6d16f34b-777c-424e-8378-3e6ba3a1e7c3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:28.876126 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-6d16f34b-777c-424e-8378-3e6ba3a1e7c3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:28.877248 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-6d16f34b-777c-424e-8378-3e6ba3a1e7c3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1333 microversion: 2.20 time: 0.092243 Jul 14 17:52:28.878090 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 30/58] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:52:28 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1333 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:52:28.921125 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-f0c8277a-26e8-4b24-932b-255549a8a9d5 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:28.928628 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-f0c8277a-26e8-4b24-932b-255549a8a9d5 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1295 microversion: 2.1 time: 0.089190 Jul 14 17:52:28.929204 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 29/59] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:28 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1295 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:52:29.587198 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-255b4cfc-8f55-4d18-a2c0-cd54dfe41ec1 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:29.587996 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-255b4cfc-8f55-4d18-a2c0-cd54dfe41ec1 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:29.594968 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-255b4cfc-8f55-4d18-a2c0-cd54dfe41ec1 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:29.595511 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-255b4cfc-8f55-4d18-a2c0-cd54dfe41ec1 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:29.596485 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-255b4cfc-8f55-4d18-a2c0-cd54dfe41ec1 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:29.597231 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-255b4cfc-8f55-4d18-a2c0-cd54dfe41ec1 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:29.630552 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-3ce686e5-8e7b-4aa8-b9e0-64ca62c514c1 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:29.631327 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-3ce686e5-8e7b-4aa8-b9e0-64ca62c514c1 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:29.637745 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3ce686e5-8e7b-4aa8-b9e0-64ca62c514c1 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:29.638242 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3ce686e5-8e7b-4aa8-b9e0-64ca62c514c1 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:29.639069 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3ce686e5-8e7b-4aa8-b9e0-64ca62c514c1 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:29.639549 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3ce686e5-8e7b-4aa8-b9e0-64ca62c514c1 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:29.660493 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-255b4cfc-8f55-4d18-a2c0-cd54dfe41ec1 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:29.668980 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-255b4cfc-8f55-4d18-a2c0-cd54dfe41ec1 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1226 microversion: 2.1 time: 0.087274 Jul 14 17:52:29.670172 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 31/60] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:29 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:29.766279 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-3ce686e5-8e7b-4aa8-b9e0-64ca62c514c1 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:29.774317 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-3ce686e5-8e7b-4aa8-b9e0-64ca62c514c1 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1315 microversion: 2.1 time: 0.147266 Jul 14 17:52:29.774886 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 30/61] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:29 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:29.896489 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-9499a7e9-b8ee-43e1-bbe9-dcd80c31c8e5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:29.897014 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-9499a7e9-b8ee-43e1-bbe9-dcd80c31c8e5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:29.903529 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9499a7e9-b8ee-43e1-bbe9-dcd80c31c8e5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:29.904008 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9499a7e9-b8ee-43e1-bbe9-dcd80c31c8e5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:29.904769 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9499a7e9-b8ee-43e1-bbe9-dcd80c31c8e5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:29.905206 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9499a7e9-b8ee-43e1-bbe9-dcd80c31c8e5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:29.946669 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-6739d585-e58b-4d94-827e-1bd6f33fc2c0 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:29.947423 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-6739d585-e58b-4d94-827e-1bd6f33fc2c0 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:29.953463 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6739d585-e58b-4d94-827e-1bd6f33fc2c0 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:29.953913 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6739d585-e58b-4d94-827e-1bd6f33fc2c0 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:29.954736 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6739d585-e58b-4d94-827e-1bd6f33fc2c0 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:29.955189 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6739d585-e58b-4d94-827e-1bd6f33fc2c0 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:29.972973 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-9499a7e9-b8ee-43e1-bbe9-dcd80c31c8e5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:29.990809 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-9499a7e9-b8ee-43e1-bbe9-dcd80c31c8e5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:29.992898 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-9499a7e9-b8ee-43e1-bbe9-dcd80c31c8e5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:29.996969 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-9499a7e9-b8ee-43e1-bbe9-dcd80c31c8e5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1333 microversion: 2.20 time: 0.104446 Jul 14 17:52:30.014494 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 32/62] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:52:29 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1333 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:52:30.082135 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-6739d585-e58b-4d94-827e-1bd6f33fc2c0 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:30.090630 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-6739d585-e58b-4d94-827e-1bd6f33fc2c0 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1295 microversion: 2.1 time: 0.148176 Jul 14 17:52:30.091210 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 31/63] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:29 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1295 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:30.685881 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-46e1c1f0-cc83-4002-bea0-f1bfb303accc tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:30.686424 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-46e1c1f0-cc83-4002-bea0-f1bfb303accc tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:30.692605 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-46e1c1f0-cc83-4002-bea0-f1bfb303accc tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:30.693059 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-46e1c1f0-cc83-4002-bea0-f1bfb303accc tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:30.693822 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-46e1c1f0-cc83-4002-bea0-f1bfb303accc tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:30.694262 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-46e1c1f0-cc83-4002-bea0-f1bfb303accc tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:30.754172 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-46e1c1f0-cc83-4002-bea0-f1bfb303accc tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:30.761481 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-46e1c1f0-cc83-4002-bea0-f1bfb303accc tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1226 microversion: 2.1 time: 0.079546 Jul 14 17:52:30.762038 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 33/64] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:30 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:30.791493 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-d661a2e7-7456-48f9-8f6d-537b0321acd5 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:30.792140 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-d661a2e7-7456-48f9-8f6d-537b0321acd5 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:30.798279 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d661a2e7-7456-48f9-8f6d-537b0321acd5 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:30.798752 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d661a2e7-7456-48f9-8f6d-537b0321acd5 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:30.799515 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d661a2e7-7456-48f9-8f6d-537b0321acd5 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:30.799970 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d661a2e7-7456-48f9-8f6d-537b0321acd5 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:30.927754 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-d661a2e7-7456-48f9-8f6d-537b0321acd5 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:30.935987 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-d661a2e7-7456-48f9-8f6d-537b0321acd5 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1315 microversion: 2.1 time: 0.148739 Jul 14 17:52:30.936570 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 32/65] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:30 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:31.018048 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-6099642d-1f3b-4252-9b1c-1c8f058c352f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:31.018943 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-6099642d-1f3b-4252-9b1c-1c8f058c352f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:31.020814 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell0:SELECT=4 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:52:31.027036 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6099642d-1f3b-4252-9b1c-1c8f058c352f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:31.027489 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6099642d-1f3b-4252-9b1c-1c8f058c352f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:31.028291 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6099642d-1f3b-4252-9b1c-1c8f058c352f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:31.028724 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6099642d-1f3b-4252-9b1c-1c8f058c352f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:31.092473 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-6099642d-1f3b-4252-9b1c-1c8f058c352f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:31.100863 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-6099642d-1f3b-4252-9b1c-1c8f058c352f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:31.102990 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-6099642d-1f3b-4252-9b1c-1c8f058c352f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:31.104143 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-6099642d-1f3b-4252-9b1c-1c8f058c352f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1333 microversion: 2.20 time: 0.090014 Jul 14 17:52:31.104732 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 34/66] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:52:31 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1333 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:52:31.107111 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-eb23d5a5-5ad2-45a7-9cae-78e6ece8c4eb tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:31.107755 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-eb23d5a5-5ad2-45a7-9cae-78e6ece8c4eb tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:31.113801 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-eb23d5a5-5ad2-45a7-9cae-78e6ece8c4eb tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:31.114244 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-eb23d5a5-5ad2-45a7-9cae-78e6ece8c4eb tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:31.115005 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-eb23d5a5-5ad2-45a7-9cae-78e6ece8c4eb tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:31.115441 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-eb23d5a5-5ad2-45a7-9cae-78e6ece8c4eb tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:31.176075 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-eb23d5a5-5ad2-45a7-9cae-78e6ece8c4eb tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:31.183531 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-eb23d5a5-5ad2-45a7-9cae-78e6ece8c4eb tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1295 microversion: 2.1 time: 0.080154 Jul 14 17:52:31.184125 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 33/67] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:31 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1295 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:52:31.778411 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-032d8be5-942b-4114-b78c-b166e3ccf47f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:31.779039 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-032d8be5-942b-4114-b78c-b166e3ccf47f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:31.785286 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-032d8be5-942b-4114-b78c-b166e3ccf47f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:31.785741 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-032d8be5-942b-4114-b78c-b166e3ccf47f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:31.786515 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-032d8be5-942b-4114-b78c-b166e3ccf47f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:31.786951 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-032d8be5-942b-4114-b78c-b166e3ccf47f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:31.848965 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-032d8be5-942b-4114-b78c-b166e3ccf47f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:31.856464 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-032d8be5-942b-4114-b78c-b166e3ccf47f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1226 microversion: 2.1 time: 0.082546 Jul 14 17:52:31.857025 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 35/68] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:31 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:31.953284 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-9bff4129-f5e0-458b-ac3e-ea95058a1186 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:31.953898 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-9bff4129-f5e0-458b-ac3e-ea95058a1186 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:31.960045 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9bff4129-f5e0-458b-ac3e-ea95058a1186 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:31.960491 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9bff4129-f5e0-458b-ac3e-ea95058a1186 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:31.961246 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9bff4129-f5e0-458b-ac3e-ea95058a1186 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:31.961679 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9bff4129-f5e0-458b-ac3e-ea95058a1186 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:32.086511 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-9bff4129-f5e0-458b-ac3e-ea95058a1186 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:32.094107 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-9bff4129-f5e0-458b-ac3e-ea95058a1186 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1315 microversion: 2.1 time: 0.144678 Jul 14 17:52:32.094681 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 34/69] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:31 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:32.124694 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-af841df9-02be-4ab9-a9a4-a3b6373f58a0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:32.125155 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-af841df9-02be-4ab9-a9a4-a3b6373f58a0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:32.134428 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-af841df9-02be-4ab9-a9a4-a3b6373f58a0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:32.135445 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-af841df9-02be-4ab9-a9a4-a3b6373f58a0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:32.136607 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-af841df9-02be-4ab9-a9a4-a3b6373f58a0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:32.137325 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-af841df9-02be-4ab9-a9a4-a3b6373f58a0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:32.201470 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-8a8bf42c-d9b9-4c7c-9a07-607ef2a0633f tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:32.202310 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-8a8bf42c-d9b9-4c7c-9a07-607ef2a0633f tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:32.209475 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-af841df9-02be-4ab9-a9a4-a3b6373f58a0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:32.215975 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8a8bf42c-d9b9-4c7c-9a07-607ef2a0633f tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:32.216871 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8a8bf42c-d9b9-4c7c-9a07-607ef2a0633f tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:32.218031 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8a8bf42c-d9b9-4c7c-9a07-607ef2a0633f tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:32.218837 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8a8bf42c-d9b9-4c7c-9a07-607ef2a0633f tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:32.221961 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-af841df9-02be-4ab9-a9a4-a3b6373f58a0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:32.225587 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-af841df9-02be-4ab9-a9a4-a3b6373f58a0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:32.225587 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-af841df9-02be-4ab9-a9a4-a3b6373f58a0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1333 microversion: 2.20 time: 0.105873 Jul 14 17:52:32.225587 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 36/70] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:52:32 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1333 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:52:32.283525 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-8a8bf42c-d9b9-4c7c-9a07-607ef2a0633f tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:32.292306 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-8a8bf42c-d9b9-4c7c-9a07-607ef2a0633f tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1295 microversion: 2.1 time: 0.095384 Jul 14 17:52:32.292998 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 35/71] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:32 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1295 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:52:32.880304 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-f35e9361-e764-4939-a02d-0023a9bf1af0 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:32.881005 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-f35e9361-e764-4939-a02d-0023a9bf1af0 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:32.903663 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f35e9361-e764-4939-a02d-0023a9bf1af0 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:32.904168 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f35e9361-e764-4939-a02d-0023a9bf1af0 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:32.906471 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f35e9361-e764-4939-a02d-0023a9bf1af0 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:32.906922 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f35e9361-e764-4939-a02d-0023a9bf1af0 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:32.994775 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-f35e9361-e764-4939-a02d-0023a9bf1af0 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:33.002172 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-f35e9361-e764-4939-a02d-0023a9bf1af0 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1218 microversion: 2.1 time: 0.126386 Jul 14 17:52:33.003062 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 37/72] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:32 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1218 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:33.110707 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-198f3377-e0a0-4b7d-94dc-a14bf521c177 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:33.111330 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-198f3377-e0a0-4b7d-94dc-a14bf521c177 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:33.126385 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-198f3377-e0a0-4b7d-94dc-a14bf521c177 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:33.127008 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-198f3377-e0a0-4b7d-94dc-a14bf521c177 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:33.139803 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-198f3377-e0a0-4b7d-94dc-a14bf521c177 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:33.140439 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-198f3377-e0a0-4b7d-94dc-a14bf521c177 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:33.246815 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-9e7cc03b-eb4d-4e35-84a1-ddf5aa891a46 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:33.247616 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-9e7cc03b-eb4d-4e35-84a1-ddf5aa891a46 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:33.254725 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9e7cc03b-eb4d-4e35-84a1-ddf5aa891a46 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:33.255517 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9e7cc03b-eb4d-4e35-84a1-ddf5aa891a46 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:33.256527 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9e7cc03b-eb4d-4e35-84a1-ddf5aa891a46 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:33.257367 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9e7cc03b-eb4d-4e35-84a1-ddf5aa891a46 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:33.408630 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-9e7cc03b-eb4d-4e35-84a1-ddf5aa891a46 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:33.419131 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-9e7cc03b-eb4d-4e35-84a1-ddf5aa891a46 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:33.421056 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-9e7cc03b-eb4d-4e35-84a1-ddf5aa891a46 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:33.423123 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-9e7cc03b-eb4d-4e35-84a1-ddf5aa891a46 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1339 microversion: 2.20 time: 0.180316 Jul 14 17:52:33.425971 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 38/73] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:52:33 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1339 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:52:33.448263 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-c673b53a-4280-42f2-bd8e-6efc9e904727 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:33.449147 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-c673b53a-4280-42f2-bd8e-6efc9e904727 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:33.455768 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c673b53a-4280-42f2-bd8e-6efc9e904727 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:33.456367 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c673b53a-4280-42f2-bd8e-6efc9e904727 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:33.457410 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c673b53a-4280-42f2-bd8e-6efc9e904727 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:33.457999 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c673b53a-4280-42f2-bd8e-6efc9e904727 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:33.714218 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-198f3377-e0a0-4b7d-94dc-a14bf521c177 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:33.719854 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell0:SELECT=6 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:52:33.723346 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-198f3377-e0a0-4b7d-94dc-a14bf521c177 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1315 microversion: 2.1 time: 0.616560 Jul 14 17:52:33.724239 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 36/74] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:33 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1315 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:33.791471 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-c673b53a-4280-42f2-bd8e-6efc9e904727 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:33.801442 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-c673b53a-4280-42f2-bd8e-6efc9e904727 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.374063 Jul 14 17:52:33.802227 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 39/75] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:33 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:34.019688 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-b93bb6a5-ffe3-43b6-a2bb-2d7907687e36 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:34.020339 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-b93bb6a5-ffe3-43b6-a2bb-2d7907687e36 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:34.022574 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell0:SELECT=24 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:52:34.037805 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b93bb6a5-ffe3-43b6-a2bb-2d7907687e36 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:34.038287 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b93bb6a5-ffe3-43b6-a2bb-2d7907687e36 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:34.041034 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b93bb6a5-ffe3-43b6-a2bb-2d7907687e36 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:34.045476 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b93bb6a5-ffe3-43b6-a2bb-2d7907687e36 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:34.149545 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-b93bb6a5-ffe3-43b6-a2bb-2d7907687e36 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:34.161679 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-b93bb6a5-ffe3-43b6-a2bb-2d7907687e36 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1274 microversion: 2.1 time: 0.145675 Jul 14 17:52:34.163330 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 37/76] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:34 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1274 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:34.445435 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-acb337a9-59d9-4bbf-909b-6d4343b4995c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:34.447621 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-acb337a9-59d9-4bbf-909b-6d4343b4995c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:34.450527 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell0:SELECT=14 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:52:34.456715 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-acb337a9-59d9-4bbf-909b-6d4343b4995c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:34.457899 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-acb337a9-59d9-4bbf-909b-6d4343b4995c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:34.459798 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-acb337a9-59d9-4bbf-909b-6d4343b4995c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:34.460655 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-acb337a9-59d9-4bbf-909b-6d4343b4995c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:34.632909 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-acb337a9-59d9-4bbf-909b-6d4343b4995c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:34.643675 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-acb337a9-59d9-4bbf-909b-6d4343b4995c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:34.645865 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-acb337a9-59d9-4bbf-909b-6d4343b4995c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:34.648106 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-acb337a9-59d9-4bbf-909b-6d4343b4995c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.209206 Jul 14 17:52:34.650137 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 40/77] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:52:34 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:52:34.690765 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-597a5409-0a4d-4731-8548-dafa711dedb6 req-81dfd4c3-d78f-4a3c-8be2-fdd06271afdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e8e31fc-eea3-4666-90e3-1898f92cf6ba", "tag": "b2e39af7-f885-4b8c-8d62-c542f2b4d4e2"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:52:34.712062 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-597a5409-0a4d-4731-8548-dafa711dedb6 req-81dfd4c3-d78f-4a3c-8be2-fdd06271afdd service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:34.712898 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-597a5409-0a4d-4731-8548-dafa711dedb6 req-81dfd4c3-d78f-4a3c-8be2-fdd06271afdd service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:34.742047 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-85251bc3-ffdd-42d6-a0b5-36f1574147de tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:34.742934 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-85251bc3-ffdd-42d6-a0b5-36f1574147de tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:34.744500 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-597a5409-0a4d-4731-8548-dafa711dedb6 req-81dfd4c3-d78f-4a3c-8be2-fdd06271afdd service nova] Creating event network-changed:b2e39af7-f885-4b8c-8d62-c542f2b4d4e2 for instance 1e8e31fc-eea3-4666-90e3-1898f92cf6ba on hv-cinder-84989 Jul 14 17:52:34.753806 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-597a5409-0a4d-4731-8548-dafa711dedb6 req-81dfd4c3-d78f-4a3c-8be2-fdd06271afdd service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065392 Jul 14 17:52:34.755338 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 38/78] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 17:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:52:34.756422 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-85251bc3-ffdd-42d6-a0b5-36f1574147de tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:34.756952 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-85251bc3-ffdd-42d6-a0b5-36f1574147de tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:34.759196 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-85251bc3-ffdd-42d6-a0b5-36f1574147de tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:34.770063 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-85251bc3-ffdd-42d6-a0b5-36f1574147de tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:34.820899 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-13921fae-bda8-47a1-ac2b-6b9026b3dcf6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:34.822406 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-13921fae-bda8-47a1-ac2b-6b9026b3dcf6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:34.835507 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-13921fae-bda8-47a1-ac2b-6b9026b3dcf6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:34.839073 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-13921fae-bda8-47a1-ac2b-6b9026b3dcf6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:34.842013 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-13921fae-bda8-47a1-ac2b-6b9026b3dcf6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:34.844560 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-13921fae-bda8-47a1-ac2b-6b9026b3dcf6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:35.275539 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-13921fae-bda8-47a1-ac2b-6b9026b3dcf6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:35.285760 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-85251bc3-ffdd-42d6-a0b5-36f1574147de tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:35.288397 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-13921fae-bda8-47a1-ac2b-6b9026b3dcf6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.472039 Jul 14 17:52:35.289268 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 39/79] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:34 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:35.296195 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-a3774cfc-1bf3-4cfd-8a89-f6c9742a8255 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:35.297136 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-a3774cfc-1bf3-4cfd-8a89-f6c9742a8255 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:35.298189 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-85251bc3-ffdd-42d6-a0b5-36f1574147de tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1315 microversion: 2.1 time: 0.561084 Jul 14 17:52:35.298944 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 41/80] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:34 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1315 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:52:35.304851 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a3774cfc-1bf3-4cfd-8a89-f6c9742a8255 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:35.305879 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a3774cfc-1bf3-4cfd-8a89-f6c9742a8255 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:35.306740 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a3774cfc-1bf3-4cfd-8a89-f6c9742a8255 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:35.307185 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a3774cfc-1bf3-4cfd-8a89-f6c9742a8255 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:35.379213 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-a3774cfc-1bf3-4cfd-8a89-f6c9742a8255 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:35.387697 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-a3774cfc-1bf3-4cfd-8a89-f6c9742a8255 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1274 microversion: 2.1 time: 0.096595 Jul 14 17:52:35.388310 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 40/81] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:35 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1274 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:35.667530 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-3ad151a6-b1da-4d30-b434-b46f4fc9af0e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:35.668239 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-3ad151a6-b1da-4d30-b434-b46f4fc9af0e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:35.674452 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3ad151a6-b1da-4d30-b434-b46f4fc9af0e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:35.674889 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3ad151a6-b1da-4d30-b434-b46f4fc9af0e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:35.675987 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3ad151a6-b1da-4d30-b434-b46f4fc9af0e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:35.676109 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3ad151a6-b1da-4d30-b434-b46f4fc9af0e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:35.875474 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-3ad151a6-b1da-4d30-b434-b46f4fc9af0e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:35.884270 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-3ad151a6-b1da-4d30-b434-b46f4fc9af0e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:35.885737 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-3ad151a6-b1da-4d30-b434-b46f4fc9af0e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:35.886987 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-3ad151a6-b1da-4d30-b434-b46f4fc9af0e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.224258 Jul 14 17:52:35.898117 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 42/82] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:52:35 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:52:36.306074 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-29a8ec6a-7a68-48ae-b02b-8c7ee3198496 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:36.306691 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-29a8ec6a-7a68-48ae-b02b-8c7ee3198496 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:36.315278 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-29a8ec6a-7a68-48ae-b02b-8c7ee3198496 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:36.316012 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-29a8ec6a-7a68-48ae-b02b-8c7ee3198496 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:36.316967 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-29a8ec6a-7a68-48ae-b02b-8c7ee3198496 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:36.317584 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-29a8ec6a-7a68-48ae-b02b-8c7ee3198496 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:36.318367 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-d33c8f95-cbd2-4705-ae76-ac519e5a0cba tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:36.318983 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-d33c8f95-cbd2-4705-ae76-ac519e5a0cba tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:36.327114 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d33c8f95-cbd2-4705-ae76-ac519e5a0cba tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:36.327564 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d33c8f95-cbd2-4705-ae76-ac519e5a0cba tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:36.328419 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d33c8f95-cbd2-4705-ae76-ac519e5a0cba tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:36.328855 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d33c8f95-cbd2-4705-ae76-ac519e5a0cba tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:36.578546 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-29a8ec6a-7a68-48ae-b02b-8c7ee3198496 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:36.586672 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-29a8ec6a-7a68-48ae-b02b-8c7ee3198496 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.284696 Jul 14 17:52:36.586672 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 41/83] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:36 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:52:36.591289 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-da7cecf5-7552-4950-98d4-4df861a1fabb tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:36.591902 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-da7cecf5-7552-4950-98d4-4df861a1fabb tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:36.598406 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-da7cecf5-7552-4950-98d4-4df861a1fabb tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:36.599118 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-da7cecf5-7552-4950-98d4-4df861a1fabb tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:36.599231 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-d33c8f95-cbd2-4705-ae76-ac519e5a0cba tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:36.599745 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-da7cecf5-7552-4950-98d4-4df861a1fabb tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:36.600215 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-da7cecf5-7552-4950-98d4-4df861a1fabb tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:36.608176 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-d33c8f95-cbd2-4705-ae76-ac519e5a0cba tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1315 microversion: 2.1 time: 0.293993 Jul 14 17:52:36.608940 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 43/84] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:36 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:52:36.676247 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-da7cecf5-7552-4950-98d4-4df861a1fabb tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:36.684955 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-da7cecf5-7552-4950-98d4-4df861a1fabb tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1274 microversion: 2.1 time: 0.097274 Jul 14 17:52:36.685549 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 42/85] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:36 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1274 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:36.905627 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-9ca1363a-6277-4d62-98b2-d9b6fca72320 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:36.906239 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-9ca1363a-6277-4d62-98b2-d9b6fca72320 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:36.912452 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9ca1363a-6277-4d62-98b2-d9b6fca72320 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:36.912910 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9ca1363a-6277-4d62-98b2-d9b6fca72320 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:36.913689 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9ca1363a-6277-4d62-98b2-d9b6fca72320 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:36.914137 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9ca1363a-6277-4d62-98b2-d9b6fca72320 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:37.050992 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-9ca1363a-6277-4d62-98b2-d9b6fca72320 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:37.059164 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-9ca1363a-6277-4d62-98b2-d9b6fca72320 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:37.060728 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-9ca1363a-6277-4d62-98b2-d9b6fca72320 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:37.061901 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-9ca1363a-6277-4d62-98b2-d9b6fca72320 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.160182 Jul 14 17:52:37.062693 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 44/86] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:52:36 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:52:37.603153 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-f34a4040-8cf3-4965-abfb-2a96f6ae5ff6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:37.603869 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-f34a4040-8cf3-4965-abfb-2a96f6ae5ff6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:37.610622 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f34a4040-8cf3-4965-abfb-2a96f6ae5ff6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:37.610710 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f34a4040-8cf3-4965-abfb-2a96f6ae5ff6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:37.611708 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f34a4040-8cf3-4965-abfb-2a96f6ae5ff6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:37.612285 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f34a4040-8cf3-4965-abfb-2a96f6ae5ff6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:37.626213 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-bf5ba0d6-9d6b-4fc2-90d3-cd140557e340 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:37.626831 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-bf5ba0d6-9d6b-4fc2-90d3-cd140557e340 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:37.634220 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bf5ba0d6-9d6b-4fc2-90d3-cd140557e340 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:37.634453 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=100 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:52:37.634835 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bf5ba0d6-9d6b-4fc2-90d3-cd140557e340 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:37.635624 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bf5ba0d6-9d6b-4fc2-90d3-cd140557e340 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:37.636217 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bf5ba0d6-9d6b-4fc2-90d3-cd140557e340 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:37.820439 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-f34a4040-8cf3-4965-abfb-2a96f6ae5ff6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:37.829601 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-f34a4040-8cf3-4965-abfb-2a96f6ae5ff6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.230652 Jul 14 17:52:37.830199 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 43/87] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:37 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:37.837320 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-7a15f55a-8ad7-4225-9bc9-c22e9c943048 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:37.838308 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-7a15f55a-8ad7-4225-9bc9-c22e9c943048 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:37.846150 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7a15f55a-8ad7-4225-9bc9-c22e9c943048 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:37.846913 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7a15f55a-8ad7-4225-9bc9-c22e9c943048 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:37.847698 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7a15f55a-8ad7-4225-9bc9-c22e9c943048 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:37.848169 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7a15f55a-8ad7-4225-9bc9-c22e9c943048 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:37.848281 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-bf5ba0d6-9d6b-4fc2-90d3-cd140557e340 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:37.856456 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-bf5ba0d6-9d6b-4fc2-90d3-cd140557e340 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1315 microversion: 2.1 time: 0.233976 Jul 14 17:52:37.866358 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 45/88] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:37 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:37.914446 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-7a15f55a-8ad7-4225-9bc9-c22e9c943048 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:37.921881 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-7a15f55a-8ad7-4225-9bc9-c22e9c943048 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1274 microversion: 2.1 time: 0.090504 Jul 14 17:52:37.922467 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 44/89] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:37 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1274 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:38.079325 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-44fdb3bb-2114-405c-93a5-e4986bb38bcf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:38.080003 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-44fdb3bb-2114-405c-93a5-e4986bb38bcf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:38.086344 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-44fdb3bb-2114-405c-93a5-e4986bb38bcf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:38.086799 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-44fdb3bb-2114-405c-93a5-e4986bb38bcf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:38.087572 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-44fdb3bb-2114-405c-93a5-e4986bb38bcf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:38.088036 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-44fdb3bb-2114-405c-93a5-e4986bb38bcf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:38.091983 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=100 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:52:38.224301 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-44fdb3bb-2114-405c-93a5-e4986bb38bcf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:38.233190 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-44fdb3bb-2114-405c-93a5-e4986bb38bcf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:38.234705 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-44fdb3bb-2114-405c-93a5-e4986bb38bcf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:38.235818 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-44fdb3bb-2114-405c-93a5-e4986bb38bcf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.160571 Jul 14 17:52:38.236465 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 46/90] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:52:38 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:52:38.847986 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-6c638494-1f65-4642-872d-3ae8163b83fd tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:38.848824 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-6c638494-1f65-4642-872d-3ae8163b83fd tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:38.855605 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6c638494-1f65-4642-872d-3ae8163b83fd tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:38.856085 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6c638494-1f65-4642-872d-3ae8163b83fd tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:38.856851 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6c638494-1f65-4642-872d-3ae8163b83fd tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:38.857285 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6c638494-1f65-4642-872d-3ae8163b83fd tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:38.872918 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-ea316348-919a-4f12-82da-c8c1921d6445 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:38.873534 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-ea316348-919a-4f12-82da-c8c1921d6445 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:38.879889 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ea316348-919a-4f12-82da-c8c1921d6445 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:38.880604 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ea316348-919a-4f12-82da-c8c1921d6445 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:38.881565 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ea316348-919a-4f12-82da-c8c1921d6445 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:38.882196 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ea316348-919a-4f12-82da-c8c1921d6445 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:39.068783 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-6c638494-1f65-4642-872d-3ae8163b83fd tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:39.074502 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-ea316348-919a-4f12-82da-c8c1921d6445 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:39.079456 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-6c638494-1f65-4642-872d-3ae8163b83fd tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.235388 Jul 14 17:52:39.089609 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 45/91] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:38 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:39.089609 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-e12ecc26-97a7-4adf-9a73-2718a3ceeedc tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:39.089609 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-e12ecc26-97a7-4adf-9a73-2718a3ceeedc tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:39.091521 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e12ecc26-97a7-4adf-9a73-2718a3ceeedc tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:39.091991 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e12ecc26-97a7-4adf-9a73-2718a3ceeedc tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:39.092639 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-ea316348-919a-4f12-82da-c8c1921d6445 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1315 microversion: 2.1 time: 0.223430 Jul 14 17:52:39.093072 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e12ecc26-97a7-4adf-9a73-2718a3ceeedc tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:39.093181 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e12ecc26-97a7-4adf-9a73-2718a3ceeedc tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:39.096472 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 47/92] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:38 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:52:39.163702 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-e12ecc26-97a7-4adf-9a73-2718a3ceeedc tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:39.171846 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-e12ecc26-97a7-4adf-9a73-2718a3ceeedc tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1274 microversion: 2.1 time: 0.090739 Jul 14 17:52:39.172474 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 46/93] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:39 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1274 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:39.253841 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-02c322d9-01d2-4d55-b6b5-7a7ddb0a49fb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:39.254473 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-02c322d9-01d2-4d55-b6b5-7a7ddb0a49fb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:39.260557 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-02c322d9-01d2-4d55-b6b5-7a7ddb0a49fb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:39.261016 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-02c322d9-01d2-4d55-b6b5-7a7ddb0a49fb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:39.261792 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-02c322d9-01d2-4d55-b6b5-7a7ddb0a49fb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:39.262238 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-02c322d9-01d2-4d55-b6b5-7a7ddb0a49fb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:39.395825 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-02c322d9-01d2-4d55-b6b5-7a7ddb0a49fb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:39.404210 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-02c322d9-01d2-4d55-b6b5-7a7ddb0a49fb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:39.405769 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-02c322d9-01d2-4d55-b6b5-7a7ddb0a49fb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:39.406868 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-02c322d9-01d2-4d55-b6b5-7a7ddb0a49fb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.156979 Jul 14 17:52:39.407432 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 48/94] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:52:39 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:52:40.096876 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-90f9a06d-df96-4a7b-978c-94b493459aaf tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:40.097493 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-90f9a06d-df96-4a7b-978c-94b493459aaf tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:40.104203 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-90f9a06d-df96-4a7b-978c-94b493459aaf tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:40.104737 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-90f9a06d-df96-4a7b-978c-94b493459aaf tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:40.105511 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-90f9a06d-df96-4a7b-978c-94b493459aaf tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:40.105968 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-90f9a06d-df96-4a7b-978c-94b493459aaf tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:40.109775 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-17ed91d5-7cbd-4625-a63c-271a8ec74f67 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:40.110408 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-17ed91d5-7cbd-4625-a63c-271a8ec74f67 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:40.116360 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-17ed91d5-7cbd-4625-a63c-271a8ec74f67 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:40.116809 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-17ed91d5-7cbd-4625-a63c-271a8ec74f67 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:40.117569 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-17ed91d5-7cbd-4625-a63c-271a8ec74f67 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:40.118065 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-17ed91d5-7cbd-4625-a63c-271a8ec74f67 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:40.305833 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-90f9a06d-df96-4a7b-978c-94b493459aaf tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:40.308881 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-17ed91d5-7cbd-4625-a63c-271a8ec74f67 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:40.315868 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-90f9a06d-df96-4a7b-978c-94b493459aaf tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.222492 Jul 14 17:52:40.316729 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-17ed91d5-7cbd-4625-a63c-271a8ec74f67 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1315 microversion: 2.1 time: 0.210838 Jul 14 17:52:40.316892 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 47/95] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:40 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:40.317297 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 49/96] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:40 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:52:40.323351 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-f9d30b3d-ac41-4394-9a20-3465aa57a643 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:40.324246 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-f9d30b3d-ac41-4394-9a20-3465aa57a643 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:40.331040 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f9d30b3d-ac41-4394-9a20-3465aa57a643 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:40.331534 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f9d30b3d-ac41-4394-9a20-3465aa57a643 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:40.332320 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f9d30b3d-ac41-4394-9a20-3465aa57a643 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:40.332761 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f9d30b3d-ac41-4394-9a20-3465aa57a643 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:40.397604 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-f9d30b3d-ac41-4394-9a20-3465aa57a643 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:40.405602 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-f9d30b3d-ac41-4394-9a20-3465aa57a643 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1274 microversion: 2.1 time: 0.087283 Jul 14 17:52:40.406272 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 48/97] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:40 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1274 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:40.424844 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-d0237e70-ff31-40db-a9a3-bf3b60e68d7b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:40.425456 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-d0237e70-ff31-40db-a9a3-bf3b60e68d7b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:40.431554 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d0237e70-ff31-40db-a9a3-bf3b60e68d7b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:40.432038 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d0237e70-ff31-40db-a9a3-bf3b60e68d7b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:40.432798 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d0237e70-ff31-40db-a9a3-bf3b60e68d7b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:40.433236 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d0237e70-ff31-40db-a9a3-bf3b60e68d7b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:40.560048 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-d0237e70-ff31-40db-a9a3-bf3b60e68d7b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:40.568203 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-d0237e70-ff31-40db-a9a3-bf3b60e68d7b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:40.569708 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-d0237e70-ff31-40db-a9a3-bf3b60e68d7b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:40.570809 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-d0237e70-ff31-40db-a9a3-bf3b60e68d7b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.149797 Jul 14 17:52:40.571871 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 50/98] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:52:40 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:52:41.333286 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-0b35f93b-b481-4556-afbe-6444b60d51a6 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:41.333951 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-96924aac-69cc-45b0-8fb6-db4a2f9916fb tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:41.333951 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-96924aac-69cc-45b0-8fb6-db4a2f9916fb tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:41.334379 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-0b35f93b-b481-4556-afbe-6444b60d51a6 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:41.340313 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0b35f93b-b481-4556-afbe-6444b60d51a6 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:41.340449 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-96924aac-69cc-45b0-8fb6-db4a2f9916fb tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:41.340804 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-96924aac-69cc-45b0-8fb6-db4a2f9916fb tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:41.341037 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0b35f93b-b481-4556-afbe-6444b60d51a6 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:41.341576 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-96924aac-69cc-45b0-8fb6-db4a2f9916fb tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:41.341814 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0b35f93b-b481-4556-afbe-6444b60d51a6 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:41.342009 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-96924aac-69cc-45b0-8fb6-db4a2f9916fb tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:41.342261 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0b35f93b-b481-4556-afbe-6444b60d51a6 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:41.534557 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-0b35f93b-b481-4556-afbe-6444b60d51a6 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:41.538354 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-96924aac-69cc-45b0-8fb6-db4a2f9916fb tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:41.542827 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-0b35f93b-b481-4556-afbe-6444b60d51a6 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1315 microversion: 2.1 time: 0.213334 Jul 14 17:52:41.543409 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 51/99] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:41 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:41.546412 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-96924aac-69cc-45b0-8fb6-db4a2f9916fb tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.216954 Jul 14 17:52:41.547108 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 49/100] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:41 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:41.548867 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-bd02be83-a5ad-44b8-9a44-d94bb4d1c4c4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:41.549581 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-bd02be83-a5ad-44b8-9a44-d94bb4d1c4c4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:41.555554 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bd02be83-a5ad-44b8-9a44-d94bb4d1c4c4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:41.556187 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bd02be83-a5ad-44b8-9a44-d94bb4d1c4c4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:41.556954 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bd02be83-a5ad-44b8-9a44-d94bb4d1c4c4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:41.557425 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bd02be83-a5ad-44b8-9a44-d94bb4d1c4c4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:41.589506 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-3e80611e-8c62-4866-835d-f414b1701d3f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:41.590107 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-3e80611e-8c62-4866-835d-f414b1701d3f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:41.596190 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3e80611e-8c62-4866-835d-f414b1701d3f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:41.596635 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3e80611e-8c62-4866-835d-f414b1701d3f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:41.597400 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3e80611e-8c62-4866-835d-f414b1701d3f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:41.597826 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3e80611e-8c62-4866-835d-f414b1701d3f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:41.618873 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-bd02be83-a5ad-44b8-9a44-d94bb4d1c4c4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:41.626789 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-bd02be83-a5ad-44b8-9a44-d94bb4d1c4c4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1274 microversion: 2.1 time: 0.082401 Jul 14 17:52:41.627364 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 52/101] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:41 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1274 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:41.730249 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-3e80611e-8c62-4866-835d-f414b1701d3f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:41.738363 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-3e80611e-8c62-4866-835d-f414b1701d3f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:41.740190 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-3e80611e-8c62-4866-835d-f414b1701d3f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:41.741292 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-3e80611e-8c62-4866-835d-f414b1701d3f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.156156 Jul 14 17:52:41.741843 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 50/102] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:52:41 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:52:42.561803 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-0a8abc03-20e6-425b-90d3-c54aa10a854c tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:42.562766 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-687b035b-dc37-4352-aabf-3ac61375a89a tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:42.563140 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-0a8abc03-20e6-425b-90d3-c54aa10a854c tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:42.563467 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-687b035b-dc37-4352-aabf-3ac61375a89a tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:42.575637 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0a8abc03-20e6-425b-90d3-c54aa10a854c tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:42.576669 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0a8abc03-20e6-425b-90d3-c54aa10a854c tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:42.578262 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0a8abc03-20e6-425b-90d3-c54aa10a854c tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:42.578915 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-687b035b-dc37-4352-aabf-3ac61375a89a tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:42.579890 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-687b035b-dc37-4352-aabf-3ac61375a89a tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:42.580968 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-687b035b-dc37-4352-aabf-3ac61375a89a tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:42.581570 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-687b035b-dc37-4352-aabf-3ac61375a89a tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:42.597090 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0a8abc03-20e6-425b-90d3-c54aa10a854c tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:42.895042 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-687b035b-dc37-4352-aabf-3ac61375a89a tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:42.908192 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-687b035b-dc37-4352-aabf-3ac61375a89a tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.348892 Jul 14 17:52:42.909946 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 51/103] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:42 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:52:42.916731 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-903eee8e-c2bc-4c72-bf36-a5be2cab8646 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:42.917682 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-903eee8e-c2bc-4c72-bf36-a5be2cab8646 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:42.926998 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-903eee8e-c2bc-4c72-bf36-a5be2cab8646 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:42.928038 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-903eee8e-c2bc-4c72-bf36-a5be2cab8646 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:42.929793 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-903eee8e-c2bc-4c72-bf36-a5be2cab8646 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:42.931600 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-903eee8e-c2bc-4c72-bf36-a5be2cab8646 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:42.934962 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-0a8abc03-20e6-425b-90d3-c54aa10a854c tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:42.946791 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-0a8abc03-20e6-425b-90d3-c54aa10a854c tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1315 microversion: 2.1 time: 0.390662 Jul 14 17:52:42.947419 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 53/104] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:42 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:42.955213 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-066aa09c-277c-4d6f-9640-72272921b509 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:42.956109 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-066aa09c-277c-4d6f-9640-72272921b509 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:42.968643 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-066aa09c-277c-4d6f-9640-72272921b509 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:42.969114 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-066aa09c-277c-4d6f-9640-72272921b509 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:42.970339 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-066aa09c-277c-4d6f-9640-72272921b509 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:42.971076 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-066aa09c-277c-4d6f-9640-72272921b509 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:43.173061 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-903eee8e-c2bc-4c72-bf36-a5be2cab8646 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:43.188472 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-903eee8e-c2bc-4c72-bf36-a5be2cab8646 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1280 microversion: 2.1 time: 0.276933 Jul 14 17:52:43.189431 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 52/105] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:42 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1280 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:43.385521 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-066aa09c-277c-4d6f-9640-72272921b509 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:43.395708 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-066aa09c-277c-4d6f-9640-72272921b509 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:43.402752 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-066aa09c-277c-4d6f-9640-72272921b509 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:43.404398 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-066aa09c-277c-4d6f-9640-72272921b509 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.455850 Jul 14 17:52:43.405225 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 54/106] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:52:42 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:52:43.926589 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-5fd2c085-289d-4ce6-9eb8-1a0aa1c020ed tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:43.927304 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-5fd2c085-289d-4ce6-9eb8-1a0aa1c020ed tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:43.936109 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5fd2c085-289d-4ce6-9eb8-1a0aa1c020ed tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:43.936571 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5fd2c085-289d-4ce6-9eb8-1a0aa1c020ed tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:43.937353 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5fd2c085-289d-4ce6-9eb8-1a0aa1c020ed tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:43.942753 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5fd2c085-289d-4ce6-9eb8-1a0aa1c020ed tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:43.962892 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-8b70cfa4-f8f2-47c5-842b-fececd65f3e8 req-ece017e4-74ed-4ec1-b6de-6a76495b51a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "323310aa-bd8a-4a21-9733-b1e73763a250", "tag": "bd30db4c-5dd9-4b56-9285-67801da2e116"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:52:43.973082 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-8b70cfa4-f8f2-47c5-842b-fececd65f3e8 req-ece017e4-74ed-4ec1-b6de-6a76495b51a0 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:43.973687 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-8b70cfa4-f8f2-47c5-842b-fececd65f3e8 req-ece017e4-74ed-4ec1-b6de-6a76495b51a0 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:44.001545 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-8b70cfa4-f8f2-47c5-842b-fececd65f3e8 req-ece017e4-74ed-4ec1-b6de-6a76495b51a0 service nova] Creating event network-changed:bd30db4c-5dd9-4b56-9285-67801da2e116 for instance 323310aa-bd8a-4a21-9733-b1e73763a250 on hv-cinder-84989 Jul 14 17:52:44.015841 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-8b70cfa4-f8f2-47c5-842b-fececd65f3e8 req-ece017e4-74ed-4ec1-b6de-6a76495b51a0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167318 Jul 14 17:52:44.017750 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 53/107] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 17:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:52:44.116607 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-93e1d461-d92f-4d0e-b7d7-5d872642ab71 req-b149920b-4d7a-4457-a198-18d3a3ee72cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "694a2002-80ed-4200-ad1e-83f4471de34b", "name": "network-vif-plugged", "status": "completed", "tag": "35a6a884-f267-4330-b918-3243a1a07498"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:52:44.131126 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-93e1d461-d92f-4d0e-b7d7-5d872642ab71 req-b149920b-4d7a-4457-a198-18d3a3ee72cd service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:44.131854 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-93e1d461-d92f-4d0e-b7d7-5d872642ab71 req-b149920b-4d7a-4457-a198-18d3a3ee72cd service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:44.149220 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-93e1d461-d92f-4d0e-b7d7-5d872642ab71 req-b149920b-4d7a-4457-a198-18d3a3ee72cd service nova] Creating event network-vif-plugged:35a6a884-f267-4330-b918-3243a1a07498 for instance 694a2002-80ed-4200-ad1e-83f4471de34b on hv-cinder-84989 Jul 14 17:52:44.172356 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-93e1d461-d92f-4d0e-b7d7-5d872642ab71 req-b149920b-4d7a-4457-a198-18d3a3ee72cd service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152839 Jul 14 17:52:44.173524 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 54/108] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 17:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:52:44.184443 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-1fdf4239-5b9f-4c2f-ba3d-6366c86525be tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:44.184885 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-1fdf4239-5b9f-4c2f-ba3d-6366c86525be tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:44.196182 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1fdf4239-5b9f-4c2f-ba3d-6366c86525be tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:44.199429 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1fdf4239-5b9f-4c2f-ba3d-6366c86525be tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:44.200967 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1fdf4239-5b9f-4c2f-ba3d-6366c86525be tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:44.201698 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1fdf4239-5b9f-4c2f-ba3d-6366c86525be tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:44.316994 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-5fd2c085-289d-4ce6-9eb8-1a0aa1c020ed tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:44.330808 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-5fd2c085-289d-4ce6-9eb8-1a0aa1c020ed tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.408101 Jul 14 17:52:44.331391 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 55/109] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:43 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:52:44.339776 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-46d9c830-3a53-46a7-89be-965a300898b8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:44.341711 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-46d9c830-3a53-46a7-89be-965a300898b8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:44.352399 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-46d9c830-3a53-46a7-89be-965a300898b8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:44.353560 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-46d9c830-3a53-46a7-89be-965a300898b8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:44.354785 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-46d9c830-3a53-46a7-89be-965a300898b8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:44.355376 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-46d9c830-3a53-46a7-89be-965a300898b8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:44.409168 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-1fdf4239-5b9f-4c2f-ba3d-6366c86525be tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:44.422816 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-1fdf4239-5b9f-4c2f-ba3d-6366c86525be tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1315 microversion: 2.1 time: 0.247674 Jul 14 17:52:44.423411 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 55/110] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:44 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:44.434876 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-f2f477aa-49b4-4506-a120-e49c99d8c45b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:44.436598 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-f2f477aa-49b4-4506-a120-e49c99d8c45b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:44.445964 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-46d9c830-3a53-46a7-89be-965a300898b8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:44.455994 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-46d9c830-3a53-46a7-89be-965a300898b8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1280 microversion: 2.1 time: 0.123372 Jul 14 17:52:44.456989 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 56/111] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:44 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1280 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:44.457560 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f2f477aa-49b4-4506-a120-e49c99d8c45b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:44.458103 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f2f477aa-49b4-4506-a120-e49c99d8c45b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:44.459026 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f2f477aa-49b4-4506-a120-e49c99d8c45b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:44.459740 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f2f477aa-49b4-4506-a120-e49c99d8c45b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:44.484943 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [req-bb54a6c8-5ced-45a4-9ae3-3672d316410f req-07123329-788c-46ca-a80a-c7f7f4171651 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afa45fb8-7566-483d-95ce-8f0242138b17", "tag": "babcf3c4-dfb9-4f4a-a0d8-6a98c8a91d00"}]} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:52:44.505229 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-bb54a6c8-5ced-45a4-9ae3-3672d316410f req-07123329-788c-46ca-a80a-c7f7f4171651 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:44.506030 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-bb54a6c8-5ced-45a4-9ae3-3672d316410f req-07123329-788c-46ca-a80a-c7f7f4171651 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:44.536856 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.compute.server_external_events [req-bb54a6c8-5ced-45a4-9ae3-3672d316410f req-07123329-788c-46ca-a80a-c7f7f4171651 service nova] Creating event network-changed:babcf3c4-dfb9-4f4a-a0d8-6a98c8a91d00 for instance afa45fb8-7566-483d-95ce-8f0242138b17 on hv-cinder-84989 Jul 14 17:52:44.539869 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-bb54a6c8-5ced-45a4-9ae3-3672d316410f req-07123329-788c-46ca-a80a-c7f7f4171651 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129471) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 17:52:44.541781 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9202cb57-e3c9-4e91-9802-072b3032dc30 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:44.542511 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9202cb57-e3c9-4e91-9802-072b3032dc30 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:44.543470 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9202cb57-e3c9-4e91-9802-072b3032dc30 None None] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:44.544113 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9202cb57-e3c9-4e91-9802-072b3032dc30 None None] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:44.557721 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.compute.rpcapi [None req-9202cb57-e3c9-4e91-9802-072b3032dc30 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 14 17:52:44.559319 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9202cb57-e3c9-4e91-9802-072b3032dc30 None None] Releasing lock "compute-rpcapi-router" {{(pid=129471) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 17:52:44.579017 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-9202cb57-e3c9-4e91-9802-072b3032dc30 None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101063 Jul 14 17:52:44.580576 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 57/112] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 17:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 17:52:44.702443 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-f2f477aa-49b4-4506-a120-e49c99d8c45b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:44.716238 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-f2f477aa-49b4-4506-a120-e49c99d8c45b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:44.718647 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-f2f477aa-49b4-4506-a120-e49c99d8c45b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:44.720043 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-f2f477aa-49b4-4506-a120-e49c99d8c45b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.295656 Jul 14 17:52:44.720616 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 56/113] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:52:44 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:52:45.348403 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-b50fc0ef-dae3-48df-b9d0-acda80b42205 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:45.349115 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-b50fc0ef-dae3-48df-b9d0-acda80b42205 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:45.355963 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b50fc0ef-dae3-48df-b9d0-acda80b42205 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:45.356614 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b50fc0ef-dae3-48df-b9d0-acda80b42205 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:45.357391 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b50fc0ef-dae3-48df-b9d0-acda80b42205 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:45.357832 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b50fc0ef-dae3-48df-b9d0-acda80b42205 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:45.440762 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-2b66c5ab-8e66-4e16-9719-fa26da284382 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:45.442000 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-2b66c5ab-8e66-4e16-9719-fa26da284382 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:45.449109 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2b66c5ab-8e66-4e16-9719-fa26da284382 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:45.449555 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2b66c5ab-8e66-4e16-9719-fa26da284382 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:45.450325 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2b66c5ab-8e66-4e16-9719-fa26da284382 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:45.450754 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2b66c5ab-8e66-4e16-9719-fa26da284382 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:45.522644 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-b50fc0ef-dae3-48df-b9d0-acda80b42205 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:45.530236 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-b50fc0ef-dae3-48df-b9d0-acda80b42205 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.186041 Jul 14 17:52:45.530818 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 58/114] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:45 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:45.535295 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-d9035d2a-7945-4804-a498-f940c9d12ba1 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:45.535909 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-d9035d2a-7945-4804-a498-f940c9d12ba1 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:45.537827 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:52:45.543230 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d9035d2a-7945-4804-a498-f940c9d12ba1 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:45.543886 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d9035d2a-7945-4804-a498-f940c9d12ba1 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:45.544739 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d9035d2a-7945-4804-a498-f940c9d12ba1 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:45.545105 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d9035d2a-7945-4804-a498-f940c9d12ba1 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:45.633324 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-2b66c5ab-8e66-4e16-9719-fa26da284382 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:45.641698 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-2b66c5ab-8e66-4e16-9719-fa26da284382 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1315 microversion: 2.1 time: 0.205136 Jul 14 17:52:45.642632 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 57/115] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:45 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:45.702854 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-d9035d2a-7945-4804-a498-f940c9d12ba1 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:45.710993 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-d9035d2a-7945-4804-a498-f940c9d12ba1 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.179093 Jul 14 17:52:45.711477 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 59/116] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:45 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:45.738620 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-edef4337-b8d3-40bc-bae2-5f829a077bfb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:45.739241 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-edef4337-b8d3-40bc-bae2-5f829a077bfb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:45.746335 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-edef4337-b8d3-40bc-bae2-5f829a077bfb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:45.746791 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-edef4337-b8d3-40bc-bae2-5f829a077bfb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:45.747597 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-edef4337-b8d3-40bc-bae2-5f829a077bfb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:45.748070 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-edef4337-b8d3-40bc-bae2-5f829a077bfb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:45.882469 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-edef4337-b8d3-40bc-bae2-5f829a077bfb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:45.890812 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-edef4337-b8d3-40bc-bae2-5f829a077bfb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:45.892356 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-edef4337-b8d3-40bc-bae2-5f829a077bfb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:45.893472 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-edef4337-b8d3-40bc-bae2-5f829a077bfb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.158838 Jul 14 17:52:45.894029 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 58/117] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:52:45 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:52:46.546948 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-2c26a72e-b3b4-4a1a-8459-ebb24a05d3d8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:46.547582 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-2c26a72e-b3b4-4a1a-8459-ebb24a05d3d8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:46.553763 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2c26a72e-b3b4-4a1a-8459-ebb24a05d3d8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:46.554221 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2c26a72e-b3b4-4a1a-8459-ebb24a05d3d8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:46.554999 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2c26a72e-b3b4-4a1a-8459-ebb24a05d3d8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:46.555439 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2c26a72e-b3b4-4a1a-8459-ebb24a05d3d8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:46.658255 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-913394c0-d09b-4357-9c70-ed7449e3c167 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:46.658870 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-913394c0-d09b-4357-9c70-ed7449e3c167 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:46.664986 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-913394c0-d09b-4357-9c70-ed7449e3c167 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:46.665431 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-913394c0-d09b-4357-9c70-ed7449e3c167 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:46.666196 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-913394c0-d09b-4357-9c70-ed7449e3c167 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:46.666631 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-913394c0-d09b-4357-9c70-ed7449e3c167 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:46.697133 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-2c26a72e-b3b4-4a1a-8459-ebb24a05d3d8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:46.704981 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-2c26a72e-b3b4-4a1a-8459-ebb24a05d3d8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.161761 Jul 14 17:52:46.705665 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 60/118] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:46 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:46.727660 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-2b92f276-50b1-4b78-ad44-87ecc0d4c515 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:46.728492 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-2b92f276-50b1-4b78-ad44-87ecc0d4c515 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:46.735462 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2b92f276-50b1-4b78-ad44-87ecc0d4c515 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:46.736060 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2b92f276-50b1-4b78-ad44-87ecc0d4c515 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:46.737080 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2b92f276-50b1-4b78-ad44-87ecc0d4c515 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:46.737725 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2b92f276-50b1-4b78-ad44-87ecc0d4c515 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:46.852689 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-913394c0-d09b-4357-9c70-ed7449e3c167 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:46.861057 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-913394c0-d09b-4357-9c70-ed7449e3c167 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1315 microversion: 2.1 time: 0.206387 Jul 14 17:52:46.861643 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 59/119] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:46 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:52:46.911106 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-8487d82b-694e-4593-bd60-c28f2a1d47d5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:46.912139 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-8487d82b-694e-4593-bd60-c28f2a1d47d5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:46.921395 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8487d82b-694e-4593-bd60-c28f2a1d47d5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:46.923347 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8487d82b-694e-4593-bd60-c28f2a1d47d5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:46.924552 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8487d82b-694e-4593-bd60-c28f2a1d47d5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:46.925163 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8487d82b-694e-4593-bd60-c28f2a1d47d5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:47.104850 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-2b92f276-50b1-4b78-ad44-87ecc0d4c515 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:47.112880 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-2b92f276-50b1-4b78-ad44-87ecc0d4c515 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.388967 Jul 14 17:52:47.113840 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 61/120] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:46 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:52:47.170667 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-8487d82b-694e-4593-bd60-c28f2a1d47d5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:47.178566 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-8487d82b-694e-4593-bd60-c28f2a1d47d5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:47.180087 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-8487d82b-694e-4593-bd60-c28f2a1d47d5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:47.182330 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-8487d82b-694e-4593-bd60-c28f2a1d47d5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.274169 Jul 14 17:52:47.182330 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 60/121] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:52:46 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:52:47.722747 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-bc619bd9-8030-45b9-b307-a38ff01d0925 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:47.724157 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-bc619bd9-8030-45b9-b307-a38ff01d0925 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:47.730596 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bc619bd9-8030-45b9-b307-a38ff01d0925 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:47.731152 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bc619bd9-8030-45b9-b307-a38ff01d0925 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:47.731963 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bc619bd9-8030-45b9-b307-a38ff01d0925 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:47.732548 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bc619bd9-8030-45b9-b307-a38ff01d0925 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:47.877644 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-b59277d2-fba0-4818-b177-6ccb1bdd886d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:47.878332 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-b59277d2-fba0-4818-b177-6ccb1bdd886d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:47.885866 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b59277d2-fba0-4818-b177-6ccb1bdd886d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:47.886402 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b59277d2-fba0-4818-b177-6ccb1bdd886d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:47.887427 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b59277d2-fba0-4818-b177-6ccb1bdd886d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:47.888472 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b59277d2-fba0-4818-b177-6ccb1bdd886d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:47.907652 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=100 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:52:47.936091 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-bc619bd9-8030-45b9-b307-a38ff01d0925 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:47.945164 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-bc619bd9-8030-45b9-b307-a38ff01d0925 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.226204 Jul 14 17:52:47.946174 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 62/122] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:47 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:48.039873 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-b59277d2-fba0-4818-b177-6ccb1bdd886d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:48.047711 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-b59277d2-fba0-4818-b177-6ccb1bdd886d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1315 microversion: 2.1 time: 0.174335 Jul 14 17:52:48.048321 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 61/123] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:47 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:48.130296 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-ce5f1fc7-ee24-42c7-967a-773a78b30793 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:48.130914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-ce5f1fc7-ee24-42c7-967a-773a78b30793 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:48.137854 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ce5f1fc7-ee24-42c7-967a-773a78b30793 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:48.138333 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ce5f1fc7-ee24-42c7-967a-773a78b30793 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:48.139093 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ce5f1fc7-ee24-42c7-967a-773a78b30793 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:48.139530 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ce5f1fc7-ee24-42c7-967a-773a78b30793 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:48.143815 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=100 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:52:48.199804 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-e0e23541-d9e9-4daa-8930-849e9a349e79 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:48.200638 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-e0e23541-d9e9-4daa-8930-849e9a349e79 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:48.212290 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e0e23541-d9e9-4daa-8930-849e9a349e79 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:48.213759 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e0e23541-d9e9-4daa-8930-849e9a349e79 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:48.214137 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e0e23541-d9e9-4daa-8930-849e9a349e79 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:48.214548 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e0e23541-d9e9-4daa-8930-849e9a349e79 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:48.350154 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-ce5f1fc7-ee24-42c7-967a-773a78b30793 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:48.361957 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-ce5f1fc7-ee24-42c7-967a-773a78b30793 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.235420 Jul 14 17:52:48.363353 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 63/124] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:48 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:48.401526 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-e0e23541-d9e9-4daa-8930-849e9a349e79 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:48.410956 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-e0e23541-d9e9-4daa-8930-849e9a349e79 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:48.412525 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-e0e23541-d9e9-4daa-8930-849e9a349e79 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:48.413668 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-e0e23541-d9e9-4daa-8930-849e9a349e79 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.218931 Jul 14 17:52:48.424881 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 62/125] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:52:48 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:52:48.506436 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [req-d9deadeb-b4b4-422a-8de0-c7e76d218112 req-971eb3b0-9806-42d3-9554-a47d1aaef5bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8687636-908e-466b-b6dc-3a3e607debb1", "tag": "6c1c53f4-2ce6-4875-9196-03a35b5f13c4"}]} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:52:48.518992 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-d9deadeb-b4b4-422a-8de0-c7e76d218112 req-971eb3b0-9806-42d3-9554-a47d1aaef5bf service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:48.519444 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-d9deadeb-b4b4-422a-8de0-c7e76d218112 req-971eb3b0-9806-42d3-9554-a47d1aaef5bf service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:48.539192 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.compute.server_external_events [req-d9deadeb-b4b4-422a-8de0-c7e76d218112 req-971eb3b0-9806-42d3-9554-a47d1aaef5bf service nova] Creating event network-changed:6c1c53f4-2ce6-4875-9196-03a35b5f13c4 for instance d8687636-908e-466b-b6dc-3a3e607debb1 on hv-cinder-84989 Jul 14 17:52:48.546956 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [req-d9deadeb-b4b4-422a-8de0-c7e76d218112 req-971eb3b0-9806-42d3-9554-a47d1aaef5bf service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044048 Jul 14 17:52:48.548065 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 64/126] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 17:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:52:48.963414 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-3a622fee-bca5-4925-8193-c86ee6610e28 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:48.964895 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-3a622fee-bca5-4925-8193-c86ee6610e28 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:48.972632 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3a622fee-bca5-4925-8193-c86ee6610e28 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:48.973197 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3a622fee-bca5-4925-8193-c86ee6610e28 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:48.974084 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3a622fee-bca5-4925-8193-c86ee6610e28 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:48.974679 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3a622fee-bca5-4925-8193-c86ee6610e28 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:49.069432 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-7f8c1b4e-aecf-46fc-acc5-ecadc068eeae tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:49.070187 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-7f8c1b4e-aecf-46fc-acc5-ecadc068eeae tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:49.077426 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7f8c1b4e-aecf-46fc-acc5-ecadc068eeae tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:49.078127 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7f8c1b4e-aecf-46fc-acc5-ecadc068eeae tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:49.079070 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7f8c1b4e-aecf-46fc-acc5-ecadc068eeae tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:49.079511 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7f8c1b4e-aecf-46fc-acc5-ecadc068eeae tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:49.183435 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-3a622fee-bca5-4925-8193-c86ee6610e28 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:49.184907 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-3a622fee-bca5-4925-8193-c86ee6610e28 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.226234 Jul 14 17:52:49.194463 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 63/127] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:48 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:49.255672 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-7f8c1b4e-aecf-46fc-acc5-ecadc068eeae tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:49.276350 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-7f8c1b4e-aecf-46fc-acc5-ecadc068eeae tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1315 microversion: 2.1 time: 0.212852 Jul 14 17:52:49.276936 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 65/128] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:49 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:49.379438 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-e00af863-a9b3-45fb-8029-68dc73057eeb tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:49.380090 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-e00af863-a9b3-45fb-8029-68dc73057eeb tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:49.387239 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e00af863-a9b3-45fb-8029-68dc73057eeb tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:49.387688 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e00af863-a9b3-45fb-8029-68dc73057eeb tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:49.388509 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e00af863-a9b3-45fb-8029-68dc73057eeb tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:49.388947 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e00af863-a9b3-45fb-8029-68dc73057eeb tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:49.443243 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-319940b1-52ce-4fec-b50c-7de30117ba0d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:49.444855 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-319940b1-52ce-4fec-b50c-7de30117ba0d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:49.456372 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-319940b1-52ce-4fec-b50c-7de30117ba0d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:49.457118 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-319940b1-52ce-4fec-b50c-7de30117ba0d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:49.458310 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-319940b1-52ce-4fec-b50c-7de30117ba0d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:49.459046 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-319940b1-52ce-4fec-b50c-7de30117ba0d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:49.577260 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-e00af863-a9b3-45fb-8029-68dc73057eeb tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:49.586559 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-e00af863-a9b3-45fb-8029-68dc73057eeb tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.211041 Jul 14 17:52:49.587366 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 64/129] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:49 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:49.641994 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-319940b1-52ce-4fec-b50c-7de30117ba0d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:49.651287 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-319940b1-52ce-4fec-b50c-7de30117ba0d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:49.652850 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-319940b1-52ce-4fec-b50c-7de30117ba0d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:49.653972 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-319940b1-52ce-4fec-b50c-7de30117ba0d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.219570 Jul 14 17:52:49.654697 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 66/130] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:52:49 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:52:50.202180 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-2b273ba9-2baa-43ca-a255-d1639e7ba6cc tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:50.202853 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-2b273ba9-2baa-43ca-a255-d1639e7ba6cc tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:50.208757 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2b273ba9-2baa-43ca-a255-d1639e7ba6cc tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:50.212321 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2b273ba9-2baa-43ca-a255-d1639e7ba6cc tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:50.212321 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2b273ba9-2baa-43ca-a255-d1639e7ba6cc tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:50.212321 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2b273ba9-2baa-43ca-a255-d1639e7ba6cc tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:50.297090 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-6d224864-4558-479e-bf2b-1087b16b91c2 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:50.298201 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-6d224864-4558-479e-bf2b-1087b16b91c2 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:50.312864 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6d224864-4558-479e-bf2b-1087b16b91c2 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:50.313627 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6d224864-4558-479e-bf2b-1087b16b91c2 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:50.316639 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6d224864-4558-479e-bf2b-1087b16b91c2 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:50.317905 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6d224864-4558-479e-bf2b-1087b16b91c2 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:50.400474 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-2b273ba9-2baa-43ca-a255-d1639e7ba6cc tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:50.410542 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-2b273ba9-2baa-43ca-a255-d1639e7ba6cc tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.212261 Jul 14 17:52:50.412532 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 65/131] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:50 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:50.532351 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-6d224864-4558-479e-bf2b-1087b16b91c2 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:50.544038 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-6d224864-4558-479e-bf2b-1087b16b91c2 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1315 microversion: 2.1 time: 0.253016 Jul 14 17:52:50.544942 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 67/132] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:50 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:52:50.605508 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-bd1d3955-5719-42fc-ac15-f7ec799c808d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:50.606238 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-bd1d3955-5719-42fc-ac15-f7ec799c808d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:50.612736 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-bd1d3955-5719-42fc-ac15-f7ec799c808d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:50.613098 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-bd1d3955-5719-42fc-ac15-f7ec799c808d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:50.613871 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-bd1d3955-5719-42fc-ac15-f7ec799c808d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:50.614745 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-bd1d3955-5719-42fc-ac15-f7ec799c808d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:50.672879 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-b0678d4e-de59-4841-b6fd-9a9b0d373921 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:50.674711 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-b0678d4e-de59-4841-b6fd-9a9b0d373921 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:50.681124 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b0678d4e-de59-4841-b6fd-9a9b0d373921 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:50.681806 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b0678d4e-de59-4841-b6fd-9a9b0d373921 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:50.682760 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b0678d4e-de59-4841-b6fd-9a9b0d373921 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:50.683341 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b0678d4e-de59-4841-b6fd-9a9b0d373921 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:50.813026 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-bd1d3955-5719-42fc-ac15-f7ec799c808d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:50.825085 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-bd1d3955-5719-42fc-ac15-f7ec799c808d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.224822 Jul 14 17:52:50.825923 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 66/133] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:50 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:50.862650 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-b0678d4e-de59-4841-b6fd-9a9b0d373921 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:50.872119 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-b0678d4e-de59-4841-b6fd-9a9b0d373921 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:50.874128 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-b0678d4e-de59-4841-b6fd-9a9b0d373921 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:50.875468 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-b0678d4e-de59-4841-b6fd-9a9b0d373921 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.206559 Jul 14 17:52:50.876714 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 68/134] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:52:50 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:52:51.432714 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-4b6e2f10-9bba-4c29-b053-9ba6701e475f tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:51.433600 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-4b6e2f10-9bba-4c29-b053-9ba6701e475f tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:51.442845 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4b6e2f10-9bba-4c29-b053-9ba6701e475f tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:51.443787 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4b6e2f10-9bba-4c29-b053-9ba6701e475f tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:51.444665 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4b6e2f10-9bba-4c29-b053-9ba6701e475f tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:51.446235 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4b6e2f10-9bba-4c29-b053-9ba6701e475f tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:51.562782 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-f9310b39-25fc-47ec-ac62-1c9bc77ce852 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:51.563909 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-f9310b39-25fc-47ec-ac62-1c9bc77ce852 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:51.586077 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f9310b39-25fc-47ec-ac62-1c9bc77ce852 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:51.589011 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f9310b39-25fc-47ec-ac62-1c9bc77ce852 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:51.590213 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f9310b39-25fc-47ec-ac62-1c9bc77ce852 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:51.593364 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f9310b39-25fc-47ec-ac62-1c9bc77ce852 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:51.605871 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-4b6e2f10-9bba-4c29-b053-9ba6701e475f tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:51.613554 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-4b6e2f10-9bba-4c29-b053-9ba6701e475f tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.186730 Jul 14 17:52:51.614131 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 67/135] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:51 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:51.766717 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-f9310b39-25fc-47ec-ac62-1c9bc77ce852 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:51.786459 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-f9310b39-25fc-47ec-ac62-1c9bc77ce852 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1315 microversion: 2.1 time: 0.228049 Jul 14 17:52:51.796963 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 69/136] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:51 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:52:51.844723 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-75d1953c-7c07-4525-af56-0711faa8225f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:51.845640 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-75d1953c-7c07-4525-af56-0711faa8225f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:51.864157 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-75d1953c-7c07-4525-af56-0711faa8225f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:51.864768 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-75d1953c-7c07-4525-af56-0711faa8225f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:51.865604 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-75d1953c-7c07-4525-af56-0711faa8225f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:51.866052 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-75d1953c-7c07-4525-af56-0711faa8225f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:51.894149 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-5bf0401f-7e16-4916-9b24-b0c501b03cbd tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:51.894925 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-5bf0401f-7e16-4916-9b24-b0c501b03cbd tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:51.902234 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5bf0401f-7e16-4916-9b24-b0c501b03cbd tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:51.902687 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5bf0401f-7e16-4916-9b24-b0c501b03cbd tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:51.903462 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5bf0401f-7e16-4916-9b24-b0c501b03cbd tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:51.903897 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5bf0401f-7e16-4916-9b24-b0c501b03cbd tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:52.179260 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-75d1953c-7c07-4525-af56-0711faa8225f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:52.190516 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-75d1953c-7c07-4525-af56-0711faa8225f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.350573 Jul 14 17:52:52.191309 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 68/137] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:51 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:52.221906 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-5bf0401f-7e16-4916-9b24-b0c501b03cbd tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:52.252803 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-5bf0401f-7e16-4916-9b24-b0c501b03cbd tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:52.256851 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-5bf0401f-7e16-4916-9b24-b0c501b03cbd tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:52.258464 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-5bf0401f-7e16-4916-9b24-b0c501b03cbd tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.368465 Jul 14 17:52:52.259210 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 70/138] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:52:51 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:52:52.630192 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-6427ed00-1806-4cfb-a081-b321ae7b4b95 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:52.631847 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-6427ed00-1806-4cfb-a081-b321ae7b4b95 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:52.639951 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6427ed00-1806-4cfb-a081-b321ae7b4b95 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:52.640833 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6427ed00-1806-4cfb-a081-b321ae7b4b95 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:52.641835 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6427ed00-1806-4cfb-a081-b321ae7b4b95 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:52.642376 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6427ed00-1806-4cfb-a081-b321ae7b4b95 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:52.804602 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-9c69bc2a-8381-4e1b-b36c-d97fc27411f1 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:52.805329 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-9c69bc2a-8381-4e1b-b36c-d97fc27411f1 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:52.815417 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9c69bc2a-8381-4e1b-b36c-d97fc27411f1 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:52.816356 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9c69bc2a-8381-4e1b-b36c-d97fc27411f1 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:52.818161 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9c69bc2a-8381-4e1b-b36c-d97fc27411f1 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:52.818822 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9c69bc2a-8381-4e1b-b36c-d97fc27411f1 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:52.837949 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-6427ed00-1806-4cfb-a081-b321ae7b4b95 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:52.852410 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-6427ed00-1806-4cfb-a081-b321ae7b4b95 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.225968 Jul 14 17:52:52.865168 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 69/139] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:52 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:52.991114 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-9c69bc2a-8381-4e1b-b36c-d97fc27411f1 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:52.999638 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-9c69bc2a-8381-4e1b-b36c-d97fc27411f1 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1315 microversion: 2.1 time: 0.199422 Jul 14 17:52:53.000463 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 71/140] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:52 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:52:53.206904 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-071fbaeb-8306-4891-a605-a311cbce0d16 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:53.207493 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-071fbaeb-8306-4891-a605-a311cbce0d16 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:53.219511 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-071fbaeb-8306-4891-a605-a311cbce0d16 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:53.219511 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-071fbaeb-8306-4891-a605-a311cbce0d16 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:53.219511 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-071fbaeb-8306-4891-a605-a311cbce0d16 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:53.219511 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-071fbaeb-8306-4891-a605-a311cbce0d16 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:53.277166 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-c3963735-3918-4248-bb1e-3a8da08c639d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:53.278380 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-c3963735-3918-4248-bb1e-3a8da08c639d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:53.289427 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c3963735-3918-4248-bb1e-3a8da08c639d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:53.289897 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c3963735-3918-4248-bb1e-3a8da08c639d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:53.300320 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c3963735-3918-4248-bb1e-3a8da08c639d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:53.301153 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c3963735-3918-4248-bb1e-3a8da08c639d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:53.468222 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-071fbaeb-8306-4891-a605-a311cbce0d16 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:53.483108 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-071fbaeb-8306-4891-a605-a311cbce0d16 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.278932 Jul 14 17:52:53.484001 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 70/141] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:53 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:53.497738 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-c3963735-3918-4248-bb1e-3a8da08c639d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:53.506699 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-c3963735-3918-4248-bb1e-3a8da08c639d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:53.508210 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-c3963735-3918-4248-bb1e-3a8da08c639d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:53.509766 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-c3963735-3918-4248-bb1e-3a8da08c639d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.236883 Jul 14 17:52:53.510321 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 72/142] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:52:53 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:52:53.870093 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-833e23a5-662d-40a5-9144-0e66e4324864 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:53.871516 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-833e23a5-662d-40a5-9144-0e66e4324864 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:53.878107 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-833e23a5-662d-40a5-9144-0e66e4324864 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:53.878628 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-833e23a5-662d-40a5-9144-0e66e4324864 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:53.879501 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-833e23a5-662d-40a5-9144-0e66e4324864 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:53.880018 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-833e23a5-662d-40a5-9144-0e66e4324864 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:54.018487 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-20603f2f-bab7-4613-b5e1-712a848f2dfd tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:54.019843 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-20603f2f-bab7-4613-b5e1-712a848f2dfd tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:54.026567 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-20603f2f-bab7-4613-b5e1-712a848f2dfd tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:54.027267 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-20603f2f-bab7-4613-b5e1-712a848f2dfd tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:54.028250 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-20603f2f-bab7-4613-b5e1-712a848f2dfd tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:54.029283 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-20603f2f-bab7-4613-b5e1-712a848f2dfd tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:54.034528 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-833e23a5-662d-40a5-9144-0e66e4324864 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:54.044223 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-833e23a5-662d-40a5-9144-0e66e4324864 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.178190 Jul 14 17:52:54.045325 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 71/143] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:53 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:54.194430 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-20603f2f-bab7-4613-b5e1-712a848f2dfd tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:54.210611 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-20603f2f-bab7-4613-b5e1-712a848f2dfd tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1315 microversion: 2.1 time: 0.196966 Jul 14 17:52:54.211197 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 73/144] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:54 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:52:54.501776 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-7fa3931c-bf2a-46da-a6ab-3c36b94ea045 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:54.502830 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-7fa3931c-bf2a-46da-a6ab-3c36b94ea045 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:54.513098 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7fa3931c-bf2a-46da-a6ab-3c36b94ea045 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:54.513891 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7fa3931c-bf2a-46da-a6ab-3c36b94ea045 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:54.515042 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7fa3931c-bf2a-46da-a6ab-3c36b94ea045 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:54.515912 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7fa3931c-bf2a-46da-a6ab-3c36b94ea045 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:54.531207 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-344c7e2f-bc41-4a2d-a7fb-73ddc2e3989b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:54.532281 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-344c7e2f-bc41-4a2d-a7fb-73ddc2e3989b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:54.543471 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-344c7e2f-bc41-4a2d-a7fb-73ddc2e3989b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:54.544032 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-344c7e2f-bc41-4a2d-a7fb-73ddc2e3989b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:54.544947 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-344c7e2f-bc41-4a2d-a7fb-73ddc2e3989b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:54.545498 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-344c7e2f-bc41-4a2d-a7fb-73ddc2e3989b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:54.564007 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell0:SELECT=2 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:52:54.874396 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-7fa3931c-bf2a-46da-a6ab-3c36b94ea045 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:54.882546 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-344c7e2f-bc41-4a2d-a7fb-73ddc2e3989b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:54.885518 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-7fa3931c-bf2a-46da-a6ab-3c36b94ea045 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.388287 Jul 14 17:52:54.887099 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 72/145] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:54 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:54.891669 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-344c7e2f-bc41-4a2d-a7fb-73ddc2e3989b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:54.893232 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-344c7e2f-bc41-4a2d-a7fb-73ddc2e3989b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:54.894633 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-344c7e2f-bc41-4a2d-a7fb-73ddc2e3989b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.369359 Jul 14 17:52:54.895725 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 74/146] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:52:54 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:52:55.061411 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-c27e6838-9151-47ec-a6a2-ea776682fbbd tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:55.062026 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-c27e6838-9151-47ec-a6a2-ea776682fbbd tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:55.068510 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c27e6838-9151-47ec-a6a2-ea776682fbbd tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:55.068967 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c27e6838-9151-47ec-a6a2-ea776682fbbd tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:55.069874 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c27e6838-9151-47ec-a6a2-ea776682fbbd tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:55.070347 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c27e6838-9151-47ec-a6a2-ea776682fbbd tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:55.209189 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-c27e6838-9151-47ec-a6a2-ea776682fbbd tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:55.217671 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-c27e6838-9151-47ec-a6a2-ea776682fbbd tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.160018 Jul 14 17:52:55.226435 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-d58c72ed-d82f-4da3-8372-6da8f84220da tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:55.227013 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-d58c72ed-d82f-4da3-8372-6da8f84220da tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:55.231030 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 73/147] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:55 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:55.233531 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d58c72ed-d82f-4da3-8372-6da8f84220da tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:55.233987 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d58c72ed-d82f-4da3-8372-6da8f84220da tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:55.234760 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d58c72ed-d82f-4da3-8372-6da8f84220da tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:55.235204 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d58c72ed-d82f-4da3-8372-6da8f84220da tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:55.394285 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-d58c72ed-d82f-4da3-8372-6da8f84220da tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:55.403186 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-d58c72ed-d82f-4da3-8372-6da8f84220da tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1315 microversion: 2.1 time: 0.180157 Jul 14 17:52:55.419752 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 75/148] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:55 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:52:55.911988 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-3cc98914-bcb3-40e8-954d-74d926e10ef3 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:55.912706 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-3cc98914-bcb3-40e8-954d-74d926e10ef3 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:55.918850 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3cc98914-bcb3-40e8-954d-74d926e10ef3 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:55.919414 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3cc98914-bcb3-40e8-954d-74d926e10ef3 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:55.920118 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3cc98914-bcb3-40e8-954d-74d926e10ef3 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:55.920561 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3cc98914-bcb3-40e8-954d-74d926e10ef3 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:55.924524 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-db94bbca-2d96-4b31-91ce-86c90b02b149 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:55.925069 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-db94bbca-2d96-4b31-91ce-86c90b02b149 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:55.931113 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-db94bbca-2d96-4b31-91ce-86c90b02b149 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:55.931569 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-db94bbca-2d96-4b31-91ce-86c90b02b149 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:55.932539 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-db94bbca-2d96-4b31-91ce-86c90b02b149 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:55.932979 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-db94bbca-2d96-4b31-91ce-86c90b02b149 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:56.125130 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-3cc98914-bcb3-40e8-954d-74d926e10ef3 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:56.128300 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-db94bbca-2d96-4b31-91ce-86c90b02b149 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:56.133227 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-3cc98914-bcb3-40e8-954d-74d926e10ef3 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.224983 Jul 14 17:52:56.134006 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 74/149] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:55 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:56.136459 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-db94bbca-2d96-4b31-91ce-86c90b02b149 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:56.138151 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-db94bbca-2d96-4b31-91ce-86c90b02b149 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:56.139247 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-db94bbca-2d96-4b31-91ce-86c90b02b149 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.218737 Jul 14 17:52:56.139784 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 76/150] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:52:55 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:52:56.234815 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-224d2bdc-1be2-4cab-8a1b-40ba88b19e8c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:56.235771 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-224d2bdc-1be2-4cab-8a1b-40ba88b19e8c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:56.244204 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-224d2bdc-1be2-4cab-8a1b-40ba88b19e8c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:56.244556 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-224d2bdc-1be2-4cab-8a1b-40ba88b19e8c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:56.246329 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-224d2bdc-1be2-4cab-8a1b-40ba88b19e8c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:56.246777 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-224d2bdc-1be2-4cab-8a1b-40ba88b19e8c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:56.401830 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-224d2bdc-1be2-4cab-8a1b-40ba88b19e8c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:56.411882 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-224d2bdc-1be2-4cab-8a1b-40ba88b19e8c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.181082 Jul 14 17:52:56.412759 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 75/151] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:56 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:56.430503 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-a292e7ca-dbd8-4a46-ab8c-b352c2de6c37 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:56.431897 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-a292e7ca-dbd8-4a46-ab8c-b352c2de6c37 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:56.439714 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a292e7ca-dbd8-4a46-ab8c-b352c2de6c37 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:56.440683 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a292e7ca-dbd8-4a46-ab8c-b352c2de6c37 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:56.441654 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a292e7ca-dbd8-4a46-ab8c-b352c2de6c37 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:56.442234 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a292e7ca-dbd8-4a46-ab8c-b352c2de6c37 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:56.632700 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-a292e7ca-dbd8-4a46-ab8c-b352c2de6c37 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:56.644205 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-a292e7ca-dbd8-4a46-ab8c-b352c2de6c37 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1315 microversion: 2.1 time: 0.220212 Jul 14 17:52:56.645528 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 77/152] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:56 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:57.150383 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-2c61c454-f3c5-412a-bd74-e5bc8af8ce1e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:57.151687 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-2c61c454-f3c5-412a-bd74-e5bc8af8ce1e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:57.157832 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-4ce24b84-54fb-4321-bd96-756f039339ce tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:57.158453 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-4ce24b84-54fb-4321-bd96-756f039339ce tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:57.163132 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_api:SELECT=100 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:52:57.170025 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4ce24b84-54fb-4321-bd96-756f039339ce tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:57.174590 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2c61c454-f3c5-412a-bd74-e5bc8af8ce1e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:57.175410 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4ce24b84-54fb-4321-bd96-756f039339ce tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:57.176458 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4ce24b84-54fb-4321-bd96-756f039339ce tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:57.177285 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4ce24b84-54fb-4321-bd96-756f039339ce tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:57.182502 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2c61c454-f3c5-412a-bd74-e5bc8af8ce1e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:57.183647 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2c61c454-f3c5-412a-bd74-e5bc8af8ce1e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:57.184350 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2c61c454-f3c5-412a-bd74-e5bc8af8ce1e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:57.396938 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-4ce24b84-54fb-4321-bd96-756f039339ce tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:57.406091 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-2c61c454-f3c5-412a-bd74-e5bc8af8ce1e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:57.411186 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-4ce24b84-54fb-4321-bd96-756f039339ce tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:57.413001 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-4ce24b84-54fb-4321-bd96-756f039339ce tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:57.414135 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-4ce24b84-54fb-4321-bd96-756f039339ce tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.260917 Jul 14 17:52:57.414718 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 78/153] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:52:57 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:52:57.421901 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-2c61c454-f3c5-412a-bd74-e5bc8af8ce1e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.275577 Jul 14 17:52:57.429228 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-a89c0924-66a2-4c61-a2db-a3f006274025 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:57.429848 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-a89c0924-66a2-4c61-a2db-a3f006274025 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:57.431503 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 76/154] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:57 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:57.436726 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a89c0924-66a2-4c61-a2db-a3f006274025 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:57.437181 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a89c0924-66a2-4c61-a2db-a3f006274025 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:57.437938 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a89c0924-66a2-4c61-a2db-a3f006274025 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:57.438419 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a89c0924-66a2-4c61-a2db-a3f006274025 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:57.609205 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-2e6804e0-23a0-4ce7-9b55-a7632aecf7a8 req-9168e7ad-92ac-4e5e-a39b-4339d7238baf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e8e31fc-eea3-4666-90e3-1898f92cf6ba", "name": "network-vif-plugged", "status": "completed", "tag": "b2e39af7-f885-4b8c-8d62-c542f2b4d4e2"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:52:57.632126 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-2e6804e0-23a0-4ce7-9b55-a7632aecf7a8 req-9168e7ad-92ac-4e5e-a39b-4339d7238baf service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:57.637356 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-2e6804e0-23a0-4ce7-9b55-a7632aecf7a8 req-9168e7ad-92ac-4e5e-a39b-4339d7238baf service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:57.674371 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-2e6804e0-23a0-4ce7-9b55-a7632aecf7a8 req-9168e7ad-92ac-4e5e-a39b-4339d7238baf service nova] Creating event network-vif-plugged:b2e39af7-f885-4b8c-8d62-c542f2b4d4e2 for instance 1e8e31fc-eea3-4666-90e3-1898f92cf6ba on hv-cinder-84989 Jul 14 17:52:57.677991 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-a89c0924-66a2-4c61-a2db-a3f006274025 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:57.690780 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-2e6804e0-23a0-4ce7-9b55-a7632aecf7a8 req-9168e7ad-92ac-4e5e-a39b-4339d7238baf service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089704 Jul 14 17:52:57.691776 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 77/155] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 17:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 17:52:57.697427 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-a89c0924-66a2-4c61-a2db-a3f006274025 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.271980 Jul 14 17:52:57.698238 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 79/156] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:57 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:57.714169 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-436b7779-5c06-426b-9d96-108c45626303 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:57.714877 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-436b7779-5c06-426b-9d96-108c45626303 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:57.734370 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-436b7779-5c06-426b-9d96-108c45626303 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:57.734809 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-436b7779-5c06-426b-9d96-108c45626303 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:57.735757 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-436b7779-5c06-426b-9d96-108c45626303 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:57.746844 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-436b7779-5c06-426b-9d96-108c45626303 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:57.931635 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-436b7779-5c06-426b-9d96-108c45626303 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:57.940664 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=100 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:52:57.960246 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-436b7779-5c06-426b-9d96-108c45626303 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1315 microversion: 2.1 time: 0.267196 Jul 14 17:52:57.960990 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 78/157] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:57 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:58.432882 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-b695f8f5-3d71-4f80-84ef-e88533e0f5b1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:58.433895 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-b695f8f5-3d71-4f80-84ef-e88533e0f5b1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:58.439625 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-42f7f32a-9e33-4508-80c4-75a394067e2e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:58.440709 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-42f7f32a-9e33-4508-80c4-75a394067e2e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:58.441002 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b695f8f5-3d71-4f80-84ef-e88533e0f5b1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:58.441455 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b695f8f5-3d71-4f80-84ef-e88533e0f5b1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:58.442454 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b695f8f5-3d71-4f80-84ef-e88533e0f5b1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:58.442888 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b695f8f5-3d71-4f80-84ef-e88533e0f5b1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:58.449518 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-42f7f32a-9e33-4508-80c4-75a394067e2e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:58.449966 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-42f7f32a-9e33-4508-80c4-75a394067e2e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:58.451752 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-42f7f32a-9e33-4508-80c4-75a394067e2e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:58.452380 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-42f7f32a-9e33-4508-80c4-75a394067e2e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:58.464067 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=100 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:52:58.651193 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-b695f8f5-3d71-4f80-84ef-e88533e0f5b1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:58.661288 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-b695f8f5-3d71-4f80-84ef-e88533e0f5b1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:58.663278 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-b695f8f5-3d71-4f80-84ef-e88533e0f5b1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:58.664143 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-b695f8f5-3d71-4f80-84ef-e88533e0f5b1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.235069 Jul 14 17:52:58.664936 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 80/158] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:52:58 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:52:58.667418 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-42f7f32a-9e33-4508-80c4-75a394067e2e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:58.676403 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-42f7f32a-9e33-4508-80c4-75a394067e2e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.241225 Jul 14 17:52:58.676972 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 79/159] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:58 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:58.715347 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-a07ef7e6-0ff9-4187-88fd-f6688596caeb tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:58.715992 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-a07ef7e6-0ff9-4187-88fd-f6688596caeb tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:58.724233 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a07ef7e6-0ff9-4187-88fd-f6688596caeb tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:58.724710 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a07ef7e6-0ff9-4187-88fd-f6688596caeb tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:58.725466 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a07ef7e6-0ff9-4187-88fd-f6688596caeb tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:58.726165 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a07ef7e6-0ff9-4187-88fd-f6688596caeb tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:58.862862 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-a07ef7e6-0ff9-4187-88fd-f6688596caeb tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:58.870687 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-a07ef7e6-0ff9-4187-88fd-f6688596caeb tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.159762 Jul 14 17:52:58.871260 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 81/160] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:58 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:58.981570 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-f21e11f9-1ead-4083-a5d7-16bf5a37d0b0 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:58.981570 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-f21e11f9-1ead-4083-a5d7-16bf5a37d0b0 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:58.989021 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f21e11f9-1ead-4083-a5d7-16bf5a37d0b0 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:58.989474 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f21e11f9-1ead-4083-a5d7-16bf5a37d0b0 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:58.990240 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f21e11f9-1ead-4083-a5d7-16bf5a37d0b0 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:58.990675 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f21e11f9-1ead-4083-a5d7-16bf5a37d0b0 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:59.301444 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-f21e11f9-1ead-4083-a5d7-16bf5a37d0b0 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:59.310889 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-f21e11f9-1ead-4083-a5d7-16bf5a37d0b0 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1502 microversion: 2.1 time: 0.335974 Jul 14 17:52:59.311787 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 80/161] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:58 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1502 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:52:59.683199 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-50311716-8e83-443d-8ef0-e1f2a5cc4b12 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:59.684529 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-50311716-8e83-443d-8ef0-e1f2a5cc4b12 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:59.692604 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-690543af-e7d0-4acf-9ace-25822a181dd6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:59.694222 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-690543af-e7d0-4acf-9ace-25822a181dd6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:59.704147 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-690543af-e7d0-4acf-9ace-25822a181dd6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:59.705008 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-690543af-e7d0-4acf-9ace-25822a181dd6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:59.705790 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-690543af-e7d0-4acf-9ace-25822a181dd6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:59.706231 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-690543af-e7d0-4acf-9ace-25822a181dd6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:59.709074 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-50311716-8e83-443d-8ef0-e1f2a5cc4b12 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:59.709805 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-50311716-8e83-443d-8ef0-e1f2a5cc4b12 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:59.710706 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-50311716-8e83-443d-8ef0-e1f2a5cc4b12 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:59.711321 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-50311716-8e83-443d-8ef0-e1f2a5cc4b12 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:59.913613 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-690543af-e7d0-4acf-9ace-25822a181dd6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:59.916109 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-50311716-8e83-443d-8ef0-e1f2a5cc4b12 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:59.923500 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-690543af-e7d0-4acf-9ace-25822a181dd6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.235001 Jul 14 17:52:59.924113 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 81/162] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:59 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:52:59.933205 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-50311716-8e83-443d-8ef0-e1f2a5cc4b12 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:59.933205 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-50311716-8e83-443d-8ef0-e1f2a5cc4b12 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:52:59.933205 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-50311716-8e83-443d-8ef0-e1f2a5cc4b12 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.248426 Jul 14 17:52:59.933492 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 82/163] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:52:59 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:52:59.933492 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-7d09e8a0-663c-42ee-8365-033a40edfe3b tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:52:59.933492 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-7d09e8a0-663c-42ee-8365-033a40edfe3b tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:52:59.939490 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7d09e8a0-663c-42ee-8365-033a40edfe3b tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:59.939952 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7d09e8a0-663c-42ee-8365-033a40edfe3b tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:52:59.941089 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7d09e8a0-663c-42ee-8365-033a40edfe3b tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:52:59.941518 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7d09e8a0-663c-42ee-8365-033a40edfe3b tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:00.072720 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-7d09e8a0-663c-42ee-8365-033a40edfe3b tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:00.080368 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-7d09e8a0-663c-42ee-8365-033a40edfe3b tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.151359 Jul 14 17:53:00.080933 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 83/164] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:52:59 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:00.940555 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-2ae3c6b2-f6d6-4225-80d7-650dc16a9db7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:00.941269 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-2ae3c6b2-f6d6-4225-80d7-650dc16a9db7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:00.944672 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-9a9e263b-e4ed-4395-a0dc-5e10e8477726 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:00.945284 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-9a9e263b-e4ed-4395-a0dc-5e10e8477726 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:00.947152 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2ae3c6b2-f6d6-4225-80d7-650dc16a9db7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:00.947600 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2ae3c6b2-f6d6-4225-80d7-650dc16a9db7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:00.948982 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2ae3c6b2-f6d6-4225-80d7-650dc16a9db7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:00.949418 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2ae3c6b2-f6d6-4225-80d7-650dc16a9db7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:00.952039 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9a9e263b-e4ed-4395-a0dc-5e10e8477726 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:00.952502 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9a9e263b-e4ed-4395-a0dc-5e10e8477726 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:00.953273 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9a9e263b-e4ed-4395-a0dc-5e10e8477726 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:00.953716 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9a9e263b-e4ed-4395-a0dc-5e10e8477726 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:01.136312 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-2ae3c6b2-f6d6-4225-80d7-650dc16a9db7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:01.143943 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-2ae3c6b2-f6d6-4225-80d7-650dc16a9db7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.207676 Jul 14 17:53:01.145402 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 82/165] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:00 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:01.147167 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-9a9e263b-e4ed-4395-a0dc-5e10e8477726 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:01.150204 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-12a80f1c-2b93-4cd7-9171-e0e2f3d213ce tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:01.150811 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-12a80f1c-2b93-4cd7-9171-e0e2f3d213ce tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:01.155482 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-9a9e263b-e4ed-4395-a0dc-5e10e8477726 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:01.157015 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-9a9e263b-e4ed-4395-a0dc-5e10e8477726 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:01.157154 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-12a80f1c-2b93-4cd7-9171-e0e2f3d213ce tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:01.157468 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-12a80f1c-2b93-4cd7-9171-e0e2f3d213ce tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:01.158118 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-9a9e263b-e4ed-4395-a0dc-5e10e8477726 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.217613 Jul 14 17:53:01.158229 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-12a80f1c-2b93-4cd7-9171-e0e2f3d213ce tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:01.158632 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-12a80f1c-2b93-4cd7-9171-e0e2f3d213ce tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:01.158971 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 84/166] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:53:00 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:53:01.284640 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-12a80f1c-2b93-4cd7-9171-e0e2f3d213ce tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:01.292482 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-12a80f1c-2b93-4cd7-9171-e0e2f3d213ce tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.145529 Jul 14 17:53:01.293085 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 83/167] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:01 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:02.161463 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-ac592906-1a96-44ea-9c75-5af413e63687 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:02.162079 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-ac592906-1a96-44ea-9c75-5af413e63687 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:02.168159 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ac592906-1a96-44ea-9c75-5af413e63687 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:02.168614 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ac592906-1a96-44ea-9c75-5af413e63687 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:02.169381 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ac592906-1a96-44ea-9c75-5af413e63687 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:02.169819 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ac592906-1a96-44ea-9c75-5af413e63687 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:02.176322 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-9ad5abb7-7c03-44e0-a5d8-3daaaee47b6c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:02.176939 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-9ad5abb7-7c03-44e0-a5d8-3daaaee47b6c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:02.183368 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9ad5abb7-7c03-44e0-a5d8-3daaaee47b6c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:02.183816 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9ad5abb7-7c03-44e0-a5d8-3daaaee47b6c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:02.184609 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9ad5abb7-7c03-44e0-a5d8-3daaaee47b6c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:02.185046 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9ad5abb7-7c03-44e0-a5d8-3daaaee47b6c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:02.368587 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-ac592906-1a96-44ea-9c75-5af413e63687 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:02.373845 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-9ad5abb7-7c03-44e0-a5d8-3daaaee47b6c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:02.383027 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-ac592906-1a96-44ea-9c75-5af413e63687 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.225283 Jul 14 17:53:02.383679 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 85/168] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:02 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:02.383919 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-9ad5abb7-7c03-44e0-a5d8-3daaaee47b6c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:02.385601 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-9ad5abb7-7c03-44e0-a5d8-3daaaee47b6c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:02.387213 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-9ad5abb7-7c03-44e0-a5d8-3daaaee47b6c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.214694 Jul 14 17:53:02.388047 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 84/169] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:53:02 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:53:02.390693 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-8e6291f3-2d28-419e-b05a-6caf68622910 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:02.391471 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-8e6291f3-2d28-419e-b05a-6caf68622910 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:02.398863 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8e6291f3-2d28-419e-b05a-6caf68622910 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:02.399709 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8e6291f3-2d28-419e-b05a-6caf68622910 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:02.400735 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8e6291f3-2d28-419e-b05a-6caf68622910 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:02.401328 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8e6291f3-2d28-419e-b05a-6caf68622910 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:02.562972 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-8e6291f3-2d28-419e-b05a-6caf68622910 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:02.571568 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-8e6291f3-2d28-419e-b05a-6caf68622910 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.186036 Jul 14 17:53:02.572141 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 86/170] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:02 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:03.403010 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-ac44820b-0a46-4035-801c-89cfe560431a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:03.403953 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-ac44820b-0a46-4035-801c-89cfe560431a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:03.406534 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-4dae01d9-5edb-4822-9138-555e883d486a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:03.407168 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-4dae01d9-5edb-4822-9138-555e883d486a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:03.412733 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ac44820b-0a46-4035-801c-89cfe560431a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:03.413459 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ac44820b-0a46-4035-801c-89cfe560431a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:03.414510 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4dae01d9-5edb-4822-9138-555e883d486a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:03.414641 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ac44820b-0a46-4035-801c-89cfe560431a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:03.415369 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ac44820b-0a46-4035-801c-89cfe560431a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:03.415522 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4dae01d9-5edb-4822-9138-555e883d486a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:03.416535 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4dae01d9-5edb-4822-9138-555e883d486a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:03.417208 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4dae01d9-5edb-4822-9138-555e883d486a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:03.620008 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-ac44820b-0a46-4035-801c-89cfe560431a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:03.623133 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-4dae01d9-5edb-4822-9138-555e883d486a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:03.627844 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-ac44820b-0a46-4035-801c-89cfe560431a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.230587 Jul 14 17:53:03.628460 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 85/171] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:03 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:03.631608 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-4dae01d9-5edb-4822-9138-555e883d486a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:03.632866 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-d310b0ee-cccf-475a-90e9-632f12db70f0 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:03.633268 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-4dae01d9-5edb-4822-9138-555e883d486a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:03.633471 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-d310b0ee-cccf-475a-90e9-632f12db70f0 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:03.634380 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-4dae01d9-5edb-4822-9138-555e883d486a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.231673 Jul 14 17:53:03.634926 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 87/172] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:53:03 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:53:03.640023 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d310b0ee-cccf-475a-90e9-632f12db70f0 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:03.640666 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d310b0ee-cccf-475a-90e9-632f12db70f0 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:03.641729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d310b0ee-cccf-475a-90e9-632f12db70f0 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:03.642174 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d310b0ee-cccf-475a-90e9-632f12db70f0 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:03.771280 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-d310b0ee-cccf-475a-90e9-632f12db70f0 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:03.779722 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-d310b0ee-cccf-475a-90e9-632f12db70f0 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.150299 Jul 14 17:53:03.780324 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 86/173] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:03 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:04.647699 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-1c7bc529-8e26-4d81-a0c4-62bede37d89f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:04.648468 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-1c7bc529-8e26-4d81-a0c4-62bede37d89f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:04.654482 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-1e74cc47-b167-4895-8402-c6a4f9d09b99 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:04.655624 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-1e74cc47-b167-4895-8402-c6a4f9d09b99 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:04.656166 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1c7bc529-8e26-4d81-a0c4-62bede37d89f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:04.656905 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1c7bc529-8e26-4d81-a0c4-62bede37d89f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:04.657905 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1c7bc529-8e26-4d81-a0c4-62bede37d89f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:04.658342 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1c7bc529-8e26-4d81-a0c4-62bede37d89f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:04.662836 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1e74cc47-b167-4895-8402-c6a4f9d09b99 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:04.663702 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1e74cc47-b167-4895-8402-c6a4f9d09b99 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:04.664860 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1e74cc47-b167-4895-8402-c6a4f9d09b99 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:04.665692 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1e74cc47-b167-4895-8402-c6a4f9d09b99 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:04.882411 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-1c7bc529-8e26-4d81-a0c4-62bede37d89f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:04.891396 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-1c7bc529-8e26-4d81-a0c4-62bede37d89f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.249814 Jul 14 17:53:04.893940 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-1e74cc47-b167-4895-8402-c6a4f9d09b99 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:04.903187 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 88/174] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:04 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:04.903802 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-1e74cc47-b167-4895-8402-c6a4f9d09b99 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:04.905381 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-1e74cc47-b167-4895-8402-c6a4f9d09b99 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:04.906517 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-1e74cc47-b167-4895-8402-c6a4f9d09b99 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.257410 Jul 14 17:53:04.907428 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 87/175] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:53:04 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:53:04.918812 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-c36c72c0-c35e-4dbd-8a84-480a2184f04b tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:04.919535 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-c36c72c0-c35e-4dbd-8a84-480a2184f04b tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:04.925540 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c36c72c0-c35e-4dbd-8a84-480a2184f04b tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:04.925993 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c36c72c0-c35e-4dbd-8a84-480a2184f04b tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:04.926771 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c36c72c0-c35e-4dbd-8a84-480a2184f04b tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:04.927394 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c36c72c0-c35e-4dbd-8a84-480a2184f04b tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:05.086171 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-c36c72c0-c35e-4dbd-8a84-480a2184f04b tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:05.094778 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-c36c72c0-c35e-4dbd-8a84-480a2184f04b tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.190372 Jul 14 17:53:05.095465 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 89/176] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:04 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:05.909269 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-8d824db9-d5c0-41da-8a6d-6a1daf651e15 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:05.909872 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-8d824db9-d5c0-41da-8a6d-6a1daf651e15 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:05.916719 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8d824db9-d5c0-41da-8a6d-6a1daf651e15 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:05.917180 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8d824db9-d5c0-41da-8a6d-6a1daf651e15 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:05.926107 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-65388718-c74a-4182-a836-f8ae04dcd6b4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:05.926107 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-65388718-c74a-4182-a836-f8ae04dcd6b4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:05.928065 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8d824db9-d5c0-41da-8a6d-6a1daf651e15 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:05.931354 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-65388718-c74a-4182-a836-f8ae04dcd6b4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:05.932184 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8d824db9-d5c0-41da-8a6d-6a1daf651e15 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:05.936069 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-65388718-c74a-4182-a836-f8ae04dcd6b4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:05.936881 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-65388718-c74a-4182-a836-f8ae04dcd6b4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:05.937327 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-65388718-c74a-4182-a836-f8ae04dcd6b4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:06.178378 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-8d824db9-d5c0-41da-8a6d-6a1daf651e15 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:06.186075 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-65388718-c74a-4182-a836-f8ae04dcd6b4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:06.190231 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-8d824db9-d5c0-41da-8a6d-6a1daf651e15 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.284158 Jul 14 17:53:06.191390 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 88/177] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:05 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:06.197199 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-aca4b15c-3bd1-4fe1-84c6-1bf1cf15aaf1 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2f360ee-6b2f-4697-9982-f5f340e4e817"}} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:53:06.198810 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-aca4b15c-3bd1-4fe1-84c6-1bf1cf15aaf1 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:06.204617 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-65388718-c74a-4182-a836-f8ae04dcd6b4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:06.206138 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-65388718-c74a-4182-a836-f8ae04dcd6b4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:06.207275 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-65388718-c74a-4182-a836-f8ae04dcd6b4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.286587 Jul 14 17:53:06.207798 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-aca4b15c-3bd1-4fe1-84c6-1bf1cf15aaf1 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:06.208584 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-aca4b15c-3bd1-4fe1-84c6-1bf1cf15aaf1 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:06.209972 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-aca4b15c-3bd1-4fe1-84c6-1bf1cf15aaf1 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:06.210457 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-aca4b15c-3bd1-4fe1-84c6-1bf1cf15aaf1 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:06.219157 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 90/178] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:53:05 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:53:06.228756 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-2d68605e-8d3f-467b-833d-ec2353864c09 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:06.229827 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-2d68605e-8d3f-467b-833d-ec2353864c09 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:06.239092 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2d68605e-8d3f-467b-833d-ec2353864c09 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:06.239849 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2d68605e-8d3f-467b-833d-ec2353864c09 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:06.240988 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2d68605e-8d3f-467b-833d-ec2353864c09 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:06.241581 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2d68605e-8d3f-467b-833d-ec2353864c09 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:06.410829 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-2d68605e-8d3f-467b-833d-ec2353864c09 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:06.418431 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-2d68605e-8d3f-467b-833d-ec2353864c09 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.198144 Jul 14 17:53:06.427607 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 91/179] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:06 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:07.209641 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-4abbbc66-0903-4293-bebc-441ba4a5b29e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:07.210311 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-4abbbc66-0903-4293-bebc-441ba4a5b29e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:07.216685 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4abbbc66-0903-4293-bebc-441ba4a5b29e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:07.217130 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4abbbc66-0903-4293-bebc-441ba4a5b29e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:07.217888 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4abbbc66-0903-4293-bebc-441ba4a5b29e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:07.218321 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4abbbc66-0903-4293-bebc-441ba4a5b29e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:07.345197 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-4abbbc66-0903-4293-bebc-441ba4a5b29e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:07.352546 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-4abbbc66-0903-4293-bebc-441ba4a5b29e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.146782 Jul 14 17:53:07.353101 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 92/180] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:07 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:53:07.357921 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-f7462b91-e359-41af-8d0b-21cb659daf4e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:07.358518 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-f7462b91-e359-41af-8d0b-21cb659daf4e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:07.364063 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f7462b91-e359-41af-8d0b-21cb659daf4e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:07.364512 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f7462b91-e359-41af-8d0b-21cb659daf4e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:07.365298 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f7462b91-e359-41af-8d0b-21cb659daf4e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:07.365734 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f7462b91-e359-41af-8d0b-21cb659daf4e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:07.494375 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-f7462b91-e359-41af-8d0b-21cb659daf4e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:07.502144 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-f7462b91-e359-41af-8d0b-21cb659daf4e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:07.503625 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-f7462b91-e359-41af-8d0b-21cb659daf4e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:07.504738 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-f7462b91-e359-41af-8d0b-21cb659daf4e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.150729 Jul 14 17:53:07.505281 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 93/181] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:53:07 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:53:07.509583 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-500e6c0c-ec07-4d70-90c9-b811223384e8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:07.510177 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-500e6c0c-ec07-4d70-90c9-b811223384e8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:07.515731 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-500e6c0c-ec07-4d70-90c9-b811223384e8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:07.516204 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-500e6c0c-ec07-4d70-90c9-b811223384e8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:07.516982 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-500e6c0c-ec07-4d70-90c9-b811223384e8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:07.517410 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-500e6c0c-ec07-4d70-90c9-b811223384e8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:07.647011 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-500e6c0c-ec07-4d70-90c9-b811223384e8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:07.655117 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-500e6c0c-ec07-4d70-90c9-b811223384e8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.148902 Jul 14 17:53:07.655683 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 94/182] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:07 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:08.369598 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-fe7c1dcb-3ea4-418b-8140-5e7ba21fe949 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:08.370214 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-fe7c1dcb-3ea4-418b-8140-5e7ba21fe949 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:08.376436 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fe7c1dcb-3ea4-418b-8140-5e7ba21fe949 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:08.376880 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fe7c1dcb-3ea4-418b-8140-5e7ba21fe949 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:08.377631 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fe7c1dcb-3ea4-418b-8140-5e7ba21fe949 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:08.378069 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fe7c1dcb-3ea4-418b-8140-5e7ba21fe949 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:08.503499 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-fe7c1dcb-3ea4-418b-8140-5e7ba21fe949 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:08.510861 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-fe7c1dcb-3ea4-418b-8140-5e7ba21fe949 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.145018 Jul 14 17:53:08.511418 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 95/183] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:08 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:53:08.522157 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-eaf4562e-715d-4151-b546-b1085887fc10 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:08.522759 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-eaf4562e-715d-4151-b546-b1085887fc10 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:08.529026 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-eaf4562e-715d-4151-b546-b1085887fc10 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:08.529482 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-eaf4562e-715d-4151-b546-b1085887fc10 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:08.530236 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-eaf4562e-715d-4151-b546-b1085887fc10 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:08.530674 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-eaf4562e-715d-4151-b546-b1085887fc10 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:08.664861 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-eaf4562e-715d-4151-b546-b1085887fc10 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:08.673916 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-eaf4562e-715d-4151-b546-b1085887fc10 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:08.675424 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-eaf4562e-715d-4151-b546-b1085887fc10 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:08.676633 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-eaf4562e-715d-4151-b546-b1085887fc10 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.158154 Jul 14 17:53:08.677195 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 96/184] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:53:08 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:53:08.692782 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-19a38620-5b7c-461e-915d-9e67d4952b19 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:08.693407 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-19a38620-5b7c-461e-915d-9e67d4952b19 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:08.701025 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-19a38620-5b7c-461e-915d-9e67d4952b19 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:08.701025 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-19a38620-5b7c-461e-915d-9e67d4952b19 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:08.701777 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-19a38620-5b7c-461e-915d-9e67d4952b19 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:08.702546 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-19a38620-5b7c-461e-915d-9e67d4952b19 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:08.706823 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=100 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:53:08.831916 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-19a38620-5b7c-461e-915d-9e67d4952b19 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:08.840443 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-19a38620-5b7c-461e-915d-9e67d4952b19 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.152290 Jul 14 17:53:08.841031 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 97/185] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:08 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:09.526783 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-4c15175d-1427-47ee-b6cf-fa5bc669fbc6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:09.528028 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-4c15175d-1427-47ee-b6cf-fa5bc669fbc6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:09.534007 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4c15175d-1427-47ee-b6cf-fa5bc669fbc6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:09.534455 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4c15175d-1427-47ee-b6cf-fa5bc669fbc6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:09.535221 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4c15175d-1427-47ee-b6cf-fa5bc669fbc6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:09.535660 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4c15175d-1427-47ee-b6cf-fa5bc669fbc6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:09.665643 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-4c15175d-1427-47ee-b6cf-fa5bc669fbc6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:09.673214 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-4c15175d-1427-47ee-b6cf-fa5bc669fbc6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.150199 Jul 14 17:53:09.673786 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 98/186] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:09 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:53:09.694802 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-10464fe5-c6bc-4d24-8364-b9b38089c2c7 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:09.695411 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-10464fe5-c6bc-4d24-8364-b9b38089c2c7 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:09.702638 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-10464fe5-c6bc-4d24-8364-b9b38089c2c7 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:09.703084 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-10464fe5-c6bc-4d24-8364-b9b38089c2c7 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:09.703853 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-10464fe5-c6bc-4d24-8364-b9b38089c2c7 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:09.704309 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-10464fe5-c6bc-4d24-8364-b9b38089c2c7 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:09.833540 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-10464fe5-c6bc-4d24-8364-b9b38089c2c7 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:09.844170 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-10464fe5-c6bc-4d24-8364-b9b38089c2c7 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:09.846135 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-10464fe5-c6bc-4d24-8364-b9b38089c2c7 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:09.847560 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-10464fe5-c6bc-4d24-8364-b9b38089c2c7 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.156819 Jul 14 17:53:09.848293 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 99/187] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:53:09 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:53:09.858048 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-cc89806b-5a51-49a2-a8cd-93b455aba781 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:09.858743 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-cc89806b-5a51-49a2-a8cd-93b455aba781 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:09.865465 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-cc89806b-5a51-49a2-a8cd-93b455aba781 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:09.865910 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-cc89806b-5a51-49a2-a8cd-93b455aba781 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:09.866666 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-cc89806b-5a51-49a2-a8cd-93b455aba781 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:09.867095 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-cc89806b-5a51-49a2-a8cd-93b455aba781 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:09.991915 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-cc89806b-5a51-49a2-a8cd-93b455aba781 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:09.999839 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-cc89806b-5a51-49a2-a8cd-93b455aba781 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.146481 Jul 14 17:53:10.000539 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 100/188] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:09 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:53:10.690439 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-96d7f233-dcf0-4340-9190-5321958ced63 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:10.691056 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-96d7f233-dcf0-4340-9190-5321958ced63 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:10.697370 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-96d7f233-dcf0-4340-9190-5321958ced63 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:10.697825 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-96d7f233-dcf0-4340-9190-5321958ced63 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:10.698601 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-96d7f233-dcf0-4340-9190-5321958ced63 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:10.699731 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-96d7f233-dcf0-4340-9190-5321958ced63 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:10.833095 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-96d7f233-dcf0-4340-9190-5321958ced63 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:10.841331 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-96d7f233-dcf0-4340-9190-5321958ced63 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.154769 Jul 14 17:53:10.841901 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 101/189] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:10 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:53:10.867409 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-92df420e-4099-4ce8-b35e-3f89101ce19e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:10.868042 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-92df420e-4099-4ce8-b35e-3f89101ce19e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:10.874005 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-92df420e-4099-4ce8-b35e-3f89101ce19e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:10.874450 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-92df420e-4099-4ce8-b35e-3f89101ce19e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:10.875199 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-92df420e-4099-4ce8-b35e-3f89101ce19e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:10.875625 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-92df420e-4099-4ce8-b35e-3f89101ce19e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:11.005872 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-92df420e-4099-4ce8-b35e-3f89101ce19e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:11.014952 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-92df420e-4099-4ce8-b35e-3f89101ce19e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:11.016484 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-92df420e-4099-4ce8-b35e-3f89101ce19e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:11.017609 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-92df420e-4099-4ce8-b35e-3f89101ce19e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.154310 Jul 14 17:53:11.018186 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 102/190] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:53:10 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:53:11.022604 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-30c06555-8e37-4db7-838a-9610477005d4 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:11.023187 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-30c06555-8e37-4db7-838a-9610477005d4 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:11.029930 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-30c06555-8e37-4db7-838a-9610477005d4 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:11.030372 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-30c06555-8e37-4db7-838a-9610477005d4 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:11.031129 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-30c06555-8e37-4db7-838a-9610477005d4 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:11.031554 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-30c06555-8e37-4db7-838a-9610477005d4 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:11.162522 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-30c06555-8e37-4db7-838a-9610477005d4 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:11.170148 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-30c06555-8e37-4db7-838a-9610477005d4 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.150987 Jul 14 17:53:11.170843 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 103/191] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:11 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:11.859002 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-a2434c5e-daad-484e-999b-9c9388b1e9af tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:11.859629 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-a2434c5e-daad-484e-999b-9c9388b1e9af tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:11.865501 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a2434c5e-daad-484e-999b-9c9388b1e9af tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:11.865943 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a2434c5e-daad-484e-999b-9c9388b1e9af tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:11.866702 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a2434c5e-daad-484e-999b-9c9388b1e9af tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:11.867131 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a2434c5e-daad-484e-999b-9c9388b1e9af tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:11.993329 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-a2434c5e-daad-484e-999b-9c9388b1e9af tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:12.001250 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-a2434c5e-daad-484e-999b-9c9388b1e9af tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.146749 Jul 14 17:53:12.001817 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 104/192] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:11 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:53:12.035940 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-94410ffb-f7a6-4714-b707-d5ba0b135d3e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:12.036563 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-94410ffb-f7a6-4714-b707-d5ba0b135d3e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:12.042621 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-94410ffb-f7a6-4714-b707-d5ba0b135d3e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:12.043645 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-94410ffb-f7a6-4714-b707-d5ba0b135d3e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:12.044436 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-94410ffb-f7a6-4714-b707-d5ba0b135d3e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:12.044874 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-94410ffb-f7a6-4714-b707-d5ba0b135d3e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:12.174791 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-94410ffb-f7a6-4714-b707-d5ba0b135d3e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:12.182796 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-94410ffb-f7a6-4714-b707-d5ba0b135d3e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:12.184409 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-94410ffb-f7a6-4714-b707-d5ba0b135d3e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:12.185507 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-94410ffb-f7a6-4714-b707-d5ba0b135d3e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.153530 Jul 14 17:53:12.186065 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 105/193] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:53:12 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:53:12.190500 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-4e980d2e-5720-4eee-9ce8-3201998f745d tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:12.191099 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-4e980d2e-5720-4eee-9ce8-3201998f745d tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:12.197085 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4e980d2e-5720-4eee-9ce8-3201998f745d tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:12.197533 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4e980d2e-5720-4eee-9ce8-3201998f745d tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:12.198306 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4e980d2e-5720-4eee-9ce8-3201998f745d tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:12.198737 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4e980d2e-5720-4eee-9ce8-3201998f745d tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:12.327393 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-4e980d2e-5720-4eee-9ce8-3201998f745d tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:12.335242 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-4e980d2e-5720-4eee-9ce8-3201998f745d tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.148182 Jul 14 17:53:12.335812 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 106/194] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:12 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:13.018685 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-73da59a7-e466-4479-a131-3012bb339518 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:13.019351 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-73da59a7-e466-4479-a131-3012bb339518 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:13.025343 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-73da59a7-e466-4479-a131-3012bb339518 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:13.025797 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-73da59a7-e466-4479-a131-3012bb339518 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:13.026554 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-73da59a7-e466-4479-a131-3012bb339518 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:13.027025 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-73da59a7-e466-4479-a131-3012bb339518 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:13.153484 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-73da59a7-e466-4479-a131-3012bb339518 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:13.160851 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-73da59a7-e466-4479-a131-3012bb339518 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.145962 Jul 14 17:53:13.161520 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 107/195] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:13 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:53:13.202488 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-e5703e97-93ca-46e6-a090-7efbda68147d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:13.203097 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-e5703e97-93ca-46e6-a090-7efbda68147d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:13.209180 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e5703e97-93ca-46e6-a090-7efbda68147d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:13.209617 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e5703e97-93ca-46e6-a090-7efbda68147d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:13.210382 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e5703e97-93ca-46e6-a090-7efbda68147d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:13.210824 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e5703e97-93ca-46e6-a090-7efbda68147d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:13.341967 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-e5703e97-93ca-46e6-a090-7efbda68147d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:13.350395 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-e5703e97-93ca-46e6-a090-7efbda68147d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:13.351907 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-e5703e97-93ca-46e6-a090-7efbda68147d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:13.353034 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-e5703e97-93ca-46e6-a090-7efbda68147d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.154435 Jul 14 17:53:13.353608 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 108/196] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:53:13 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:53:13.358616 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-61553a6c-2964-4152-9f03-9b184a75f084 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:13.359356 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-61553a6c-2964-4152-9f03-9b184a75f084 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:13.362256 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_api:SELECT=100 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:53:13.366133 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-61553a6c-2964-4152-9f03-9b184a75f084 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:13.366579 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-61553a6c-2964-4152-9f03-9b184a75f084 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:13.367335 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-61553a6c-2964-4152-9f03-9b184a75f084 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:13.367772 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-61553a6c-2964-4152-9f03-9b184a75f084 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:13.502178 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-61553a6c-2964-4152-9f03-9b184a75f084 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:13.509614 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-61553a6c-2964-4152-9f03-9b184a75f084 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.155031 Jul 14 17:53:13.510177 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 109/197] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:13 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:14.178151 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-587ae2b3-acdf-47e4-8717-b3a656600aa3 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:14.178760 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-587ae2b3-acdf-47e4-8717-b3a656600aa3 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:14.184816 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-587ae2b3-acdf-47e4-8717-b3a656600aa3 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:14.185257 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-587ae2b3-acdf-47e4-8717-b3a656600aa3 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:14.186010 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-587ae2b3-acdf-47e4-8717-b3a656600aa3 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:14.186439 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-587ae2b3-acdf-47e4-8717-b3a656600aa3 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:14.317084 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-587ae2b3-acdf-47e4-8717-b3a656600aa3 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:14.324546 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-587ae2b3-acdf-47e4-8717-b3a656600aa3 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.150199 Jul 14 17:53:14.325105 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 110/198] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:14 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:53:14.371669 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-3e1e2c79-cb64-40df-aadb-4a7f23675941 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:14.372349 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-3e1e2c79-cb64-40df-aadb-4a7f23675941 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:14.378376 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3e1e2c79-cb64-40df-aadb-4a7f23675941 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:14.378780 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3e1e2c79-cb64-40df-aadb-4a7f23675941 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:14.379540 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3e1e2c79-cb64-40df-aadb-4a7f23675941 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:14.380013 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3e1e2c79-cb64-40df-aadb-4a7f23675941 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:14.506650 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-3e1e2c79-cb64-40df-aadb-4a7f23675941 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:14.519033 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-3e1e2c79-cb64-40df-aadb-4a7f23675941 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:14.521487 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-3e1e2c79-cb64-40df-aadb-4a7f23675941 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:14.521935 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-3e1e2c79-cb64-40df-aadb-4a7f23675941 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.153914 Jul 14 17:53:14.522277 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 111/199] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:53:14 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:53:14.528157 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-01e22693-be26-4102-90db-7596495cafac tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:14.528157 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-01e22693-be26-4102-90db-7596495cafac tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:14.534029 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-01e22693-be26-4102-90db-7596495cafac tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:14.534490 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-01e22693-be26-4102-90db-7596495cafac tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:14.535243 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-01e22693-be26-4102-90db-7596495cafac tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:14.535680 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-01e22693-be26-4102-90db-7596495cafac tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:14.662624 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-01e22693-be26-4102-90db-7596495cafac tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:14.670115 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-01e22693-be26-4102-90db-7596495cafac tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.146873 Jul 14 17:53:14.670754 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 112/200] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:14 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:15.341654 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-b706508c-81d6-4226-8fed-692bb37fb8a7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:15.342314 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-b706508c-81d6-4226-8fed-692bb37fb8a7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:15.348305 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b706508c-81d6-4226-8fed-692bb37fb8a7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:15.348748 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b706508c-81d6-4226-8fed-692bb37fb8a7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:15.349499 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b706508c-81d6-4226-8fed-692bb37fb8a7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:15.349925 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b706508c-81d6-4226-8fed-692bb37fb8a7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:15.479684 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-b706508c-81d6-4226-8fed-692bb37fb8a7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:15.483743 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=100 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:53:15.488324 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-b706508c-81d6-4226-8fed-692bb37fb8a7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.150466 Jul 14 17:53:15.488911 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 113/201] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:15 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:53:15.542389 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-edea64b1-fa86-45cc-9b61-2b337ae57b66 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:15.543540 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-edea64b1-fa86-45cc-9b61-2b337ae57b66 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:15.549856 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-edea64b1-fa86-45cc-9b61-2b337ae57b66 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:15.550337 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-edea64b1-fa86-45cc-9b61-2b337ae57b66 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:15.551196 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-edea64b1-fa86-45cc-9b61-2b337ae57b66 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:15.551626 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-edea64b1-fa86-45cc-9b61-2b337ae57b66 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:15.677407 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-edea64b1-fa86-45cc-9b61-2b337ae57b66 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:15.685523 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-edea64b1-fa86-45cc-9b61-2b337ae57b66 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:15.686928 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-edea64b1-fa86-45cc-9b61-2b337ae57b66 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:15.688059 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-edea64b1-fa86-45cc-9b61-2b337ae57b66 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.149707 Jul 14 17:53:15.688616 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 114/202] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:53:15 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:53:15.693214 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-1b12d946-174d-4071-b726-a0ab6cf01fac tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:15.693815 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-1b12d946-174d-4071-b726-a0ab6cf01fac tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:15.699770 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1b12d946-174d-4071-b726-a0ab6cf01fac tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:15.700261 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1b12d946-174d-4071-b726-a0ab6cf01fac tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:15.701025 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1b12d946-174d-4071-b726-a0ab6cf01fac tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:15.701457 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1b12d946-174d-4071-b726-a0ab6cf01fac tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:15.834040 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-1b12d946-174d-4071-b726-a0ab6cf01fac tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:15.845896 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-1b12d946-174d-4071-b726-a0ab6cf01fac tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.156027 Jul 14 17:53:15.846647 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 115/203] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:15 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:16.207318 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_api:SELECT=27 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:53:16.352076 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=67 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:53:16.506013 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-e702dfbf-428f-4a84-ad32-b88970a17c31 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:16.506617 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-e702dfbf-428f-4a84-ad32-b88970a17c31 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:16.513296 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e702dfbf-428f-4a84-ad32-b88970a17c31 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:16.513740 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e702dfbf-428f-4a84-ad32-b88970a17c31 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:16.514498 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e702dfbf-428f-4a84-ad32-b88970a17c31 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:16.514925 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e702dfbf-428f-4a84-ad32-b88970a17c31 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:16.643056 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-e702dfbf-428f-4a84-ad32-b88970a17c31 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:16.650532 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-e702dfbf-428f-4a84-ad32-b88970a17c31 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.148346 Jul 14 17:53:16.651101 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 116/204] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:16 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:53:16.706426 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-d7f1cc68-ad94-4ecc-8a22-067f5d559f2f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:16.707061 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-d7f1cc68-ad94-4ecc-8a22-067f5d559f2f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:16.713128 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d7f1cc68-ad94-4ecc-8a22-067f5d559f2f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:16.713577 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d7f1cc68-ad94-4ecc-8a22-067f5d559f2f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:16.714349 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d7f1cc68-ad94-4ecc-8a22-067f5d559f2f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:16.714788 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d7f1cc68-ad94-4ecc-8a22-067f5d559f2f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:16.844718 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-d7f1cc68-ad94-4ecc-8a22-067f5d559f2f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:16.852710 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-d7f1cc68-ad94-4ecc-8a22-067f5d559f2f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:16.854207 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-d7f1cc68-ad94-4ecc-8a22-067f5d559f2f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:16.855307 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-d7f1cc68-ad94-4ecc-8a22-067f5d559f2f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.152785 Jul 14 17:53:16.856397 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 117/205] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:53:16 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:53:16.862440 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-f5b2f730-1fda-4fea-a2fe-2cca1bc07671 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:16.863052 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-f5b2f730-1fda-4fea-a2fe-2cca1bc07671 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:16.869168 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f5b2f730-1fda-4fea-a2fe-2cca1bc07671 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:16.869624 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f5b2f730-1fda-4fea-a2fe-2cca1bc07671 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:16.870404 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f5b2f730-1fda-4fea-a2fe-2cca1bc07671 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:16.870913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f5b2f730-1fda-4fea-a2fe-2cca1bc07671 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:17.002474 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-f5b2f730-1fda-4fea-a2fe-2cca1bc07671 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:17.009948 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-f5b2f730-1fda-4fea-a2fe-2cca1bc07671 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.151178 Jul 14 17:53:17.010515 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 118/206] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:16 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:17.667384 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-f27c874c-68dd-4ab0-be1e-395a9c8d73fb tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:17.668583 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-f27c874c-68dd-4ab0-be1e-395a9c8d73fb tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:17.674831 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f27c874c-68dd-4ab0-be1e-395a9c8d73fb tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:17.675302 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f27c874c-68dd-4ab0-be1e-395a9c8d73fb tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:17.676168 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f27c874c-68dd-4ab0-be1e-395a9c8d73fb tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:17.676605 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f27c874c-68dd-4ab0-be1e-395a9c8d73fb tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:17.816669 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-f27c874c-68dd-4ab0-be1e-395a9c8d73fb tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:17.824531 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-f27c874c-68dd-4ab0-be1e-395a9c8d73fb tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.160974 Jul 14 17:53:17.825130 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 119/207] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:17 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:53:17.874526 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-2b076e46-0da7-4acc-bb10-ee81efa31a36 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:17.875046 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-2b076e46-0da7-4acc-bb10-ee81efa31a36 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:17.881080 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2b076e46-0da7-4acc-bb10-ee81efa31a36 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:17.881524 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2b076e46-0da7-4acc-bb10-ee81efa31a36 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:17.882291 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2b076e46-0da7-4acc-bb10-ee81efa31a36 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:17.882714 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2b076e46-0da7-4acc-bb10-ee81efa31a36 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:18.013527 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-2b076e46-0da7-4acc-bb10-ee81efa31a36 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:18.022281 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-2b076e46-0da7-4acc-bb10-ee81efa31a36 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:18.023798 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-2b076e46-0da7-4acc-bb10-ee81efa31a36 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:18.025764 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-2b076e46-0da7-4acc-bb10-ee81efa31a36 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.155071 Jul 14 17:53:18.032237 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 120/208] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:53:17 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:53:18.037182 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-88fcf8b5-93ab-4aaa-9d00-135cce556ea4 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:18.037905 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-88fcf8b5-93ab-4aaa-9d00-135cce556ea4 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:18.045121 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-88fcf8b5-93ab-4aaa-9d00-135cce556ea4 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:18.045567 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-88fcf8b5-93ab-4aaa-9d00-135cce556ea4 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:18.046337 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-88fcf8b5-93ab-4aaa-9d00-135cce556ea4 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:18.046755 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-88fcf8b5-93ab-4aaa-9d00-135cce556ea4 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:18.181659 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-88fcf8b5-93ab-4aaa-9d00-135cce556ea4 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:18.192726 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-88fcf8b5-93ab-4aaa-9d00-135cce556ea4 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.159193 Jul 14 17:53:18.193942 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 121/209] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:18 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:18.842909 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-6fd3a658-0c06-4396-b8ee-36775e92b489 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:18.843606 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-6fd3a658-0c06-4396-b8ee-36775e92b489 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:18.849701 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6fd3a658-0c06-4396-b8ee-36775e92b489 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:18.850159 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6fd3a658-0c06-4396-b8ee-36775e92b489 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:18.850921 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6fd3a658-0c06-4396-b8ee-36775e92b489 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:18.851363 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6fd3a658-0c06-4396-b8ee-36775e92b489 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:18.982146 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-6fd3a658-0c06-4396-b8ee-36775e92b489 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:18.989515 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-6fd3a658-0c06-4396-b8ee-36775e92b489 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.150990 Jul 14 17:53:18.990083 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 122/210] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:18 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:19.042388 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-9e48cd19-6203-4d07-bedf-5212df291be2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:19.042993 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-9e48cd19-6203-4d07-bedf-5212df291be2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:19.049444 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9e48cd19-6203-4d07-bedf-5212df291be2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:19.049893 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9e48cd19-6203-4d07-bedf-5212df291be2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:19.050652 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9e48cd19-6203-4d07-bedf-5212df291be2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:19.051091 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9e48cd19-6203-4d07-bedf-5212df291be2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:19.179276 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-9e48cd19-6203-4d07-bedf-5212df291be2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:19.187136 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-9e48cd19-6203-4d07-bedf-5212df291be2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:19.188663 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-9e48cd19-6203-4d07-bedf-5212df291be2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:19.189762 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-9e48cd19-6203-4d07-bedf-5212df291be2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.151105 Jul 14 17:53:19.190320 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 123/211] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:53:19 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:53:19.214261 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-4f00f395-8296-4a6b-a10c-e6052ef02a40 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:19.214863 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-4f00f395-8296-4a6b-a10c-e6052ef02a40 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:19.221417 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4f00f395-8296-4a6b-a10c-e6052ef02a40 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:19.221858 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4f00f395-8296-4a6b-a10c-e6052ef02a40 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:19.222609 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4f00f395-8296-4a6b-a10c-e6052ef02a40 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:19.223033 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4f00f395-8296-4a6b-a10c-e6052ef02a40 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:19.353526 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-4f00f395-8296-4a6b-a10c-e6052ef02a40 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:19.360952 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-4f00f395-8296-4a6b-a10c-e6052ef02a40 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.150373 Jul 14 17:53:19.361527 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 124/212] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:19 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:53:20.006161 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-a02e38ee-cbc0-43df-8c28-7eb73838c12b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:20.006828 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-a02e38ee-cbc0-43df-8c28-7eb73838c12b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:20.012854 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a02e38ee-cbc0-43df-8c28-7eb73838c12b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:20.013297 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a02e38ee-cbc0-43df-8c28-7eb73838c12b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:20.014056 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a02e38ee-cbc0-43df-8c28-7eb73838c12b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:20.014486 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a02e38ee-cbc0-43df-8c28-7eb73838c12b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:20.156333 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-a02e38ee-cbc0-43df-8c28-7eb73838c12b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:20.164104 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-a02e38ee-cbc0-43df-8c28-7eb73838c12b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.161680 Jul 14 17:53:20.164696 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 125/213] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:20 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:53:20.208551 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-145fd7ef-d1d1-4ce6-8d93-67253f81d4c6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:20.209168 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-145fd7ef-d1d1-4ce6-8d93-67253f81d4c6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:20.216540 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-145fd7ef-d1d1-4ce6-8d93-67253f81d4c6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:20.216942 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-145fd7ef-d1d1-4ce6-8d93-67253f81d4c6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:20.217775 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-145fd7ef-d1d1-4ce6-8d93-67253f81d4c6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:20.218222 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-145fd7ef-d1d1-4ce6-8d93-67253f81d4c6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:20.347503 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-145fd7ef-d1d1-4ce6-8d93-67253f81d4c6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:20.355463 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-145fd7ef-d1d1-4ce6-8d93-67253f81d4c6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:20.357678 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-145fd7ef-d1d1-4ce6-8d93-67253f81d4c6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:20.358803 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-145fd7ef-d1d1-4ce6-8d93-67253f81d4c6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.154314 Jul 14 17:53:20.359364 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 126/214] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:53:20 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:53:20.377214 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-8182a64c-ff39-4611-a663-b1ca662f1650 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:20.377824 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-8182a64c-ff39-4611-a663-b1ca662f1650 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:20.383610 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8182a64c-ff39-4611-a663-b1ca662f1650 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:20.384107 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8182a64c-ff39-4611-a663-b1ca662f1650 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:20.384876 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8182a64c-ff39-4611-a663-b1ca662f1650 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:20.385314 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8182a64c-ff39-4611-a663-b1ca662f1650 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:20.515848 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-8182a64c-ff39-4611-a663-b1ca662f1650 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:20.523471 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-8182a64c-ff39-4611-a663-b1ca662f1650 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.149716 Jul 14 17:53:20.524064 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 127/215] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:20 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:53:21.181666 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-6f8680e3-00f4-400c-b802-d731ca38fb0f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:21.182268 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-6f8680e3-00f4-400c-b802-d731ca38fb0f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:21.188377 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6f8680e3-00f4-400c-b802-d731ca38fb0f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:21.188829 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6f8680e3-00f4-400c-b802-d731ca38fb0f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:21.189595 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6f8680e3-00f4-400c-b802-d731ca38fb0f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:21.190035 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6f8680e3-00f4-400c-b802-d731ca38fb0f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:21.321923 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-6f8680e3-00f4-400c-b802-d731ca38fb0f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:21.329906 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-6f8680e3-00f4-400c-b802-d731ca38fb0f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.152171 Jul 14 17:53:21.330475 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 128/216] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:21 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:53:21.376410 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-6683c866-63fa-4ae1-a95b-093fe1303fb2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:21.376949 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-6683c866-63fa-4ae1-a95b-093fe1303fb2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:21.382815 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6683c866-63fa-4ae1-a95b-093fe1303fb2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:21.383270 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6683c866-63fa-4ae1-a95b-093fe1303fb2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:21.384057 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6683c866-63fa-4ae1-a95b-093fe1303fb2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:21.384495 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6683c866-63fa-4ae1-a95b-093fe1303fb2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:21.514782 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-6683c866-63fa-4ae1-a95b-093fe1303fb2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:21.522954 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-6683c866-63fa-4ae1-a95b-093fe1303fb2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:21.524494 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-6683c866-63fa-4ae1-a95b-093fe1303fb2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:21.525637 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-6683c866-63fa-4ae1-a95b-093fe1303fb2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.153049 Jul 14 17:53:21.526196 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 129/217] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:53:21 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:53:21.540754 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-98335a5f-8d5e-4cb3-a9a8-0a476c9cf317 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:21.541361 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-98335a5f-8d5e-4cb3-a9a8-0a476c9cf317 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:21.549725 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-98335a5f-8d5e-4cb3-a9a8-0a476c9cf317 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:21.550306 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-98335a5f-8d5e-4cb3-a9a8-0a476c9cf317 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:21.551083 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-98335a5f-8d5e-4cb3-a9a8-0a476c9cf317 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:21.552025 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-98335a5f-8d5e-4cb3-a9a8-0a476c9cf317 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:21.572452 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=100 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:53:21.687122 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-98335a5f-8d5e-4cb3-a9a8-0a476c9cf317 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:21.697650 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-98335a5f-8d5e-4cb3-a9a8-0a476c9cf317 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.160395 Jul 14 17:53:21.707018 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 130/218] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:21 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:53:21.716230 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [req-1e4c4c51-f467-4666-b1d0-bd0f06c2e62f req-642a030b-457d-478e-8d81-155b94124465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afa45fb8-7566-483d-95ce-8f0242138b17", "name": "network-vif-plugged", "status": "completed", "tag": "babcf3c4-dfb9-4f4a-a0d8-6a98c8a91d00"}]} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:53:21.728034 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-1e4c4c51-f467-4666-b1d0-bd0f06c2e62f req-642a030b-457d-478e-8d81-155b94124465 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:21.728489 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-1e4c4c51-f467-4666-b1d0-bd0f06c2e62f req-642a030b-457d-478e-8d81-155b94124465 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:21.739871 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.compute.server_external_events [req-1e4c4c51-f467-4666-b1d0-bd0f06c2e62f req-642a030b-457d-478e-8d81-155b94124465 service nova] Creating event network-vif-plugged:babcf3c4-dfb9-4f4a-a0d8-6a98c8a91d00 for instance afa45fb8-7566-483d-95ce-8f0242138b17 on hv-cinder-84989 Jul 14 17:53:21.744975 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [req-1e4c4c51-f467-4666-b1d0-bd0f06c2e62f req-642a030b-457d-478e-8d81-155b94124465 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036743 Jul 14 17:53:21.745568 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 131/219] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 17:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:53:22.347122 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-1b1a3b41-d851-48c8-adce-d2bcb30d9ddc tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:22.348076 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-1b1a3b41-d851-48c8-adce-d2bcb30d9ddc tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:22.354426 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1b1a3b41-d851-48c8-adce-d2bcb30d9ddc tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:22.354874 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1b1a3b41-d851-48c8-adce-d2bcb30d9ddc tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:22.355637 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1b1a3b41-d851-48c8-adce-d2bcb30d9ddc tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:22.356587 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1b1a3b41-d851-48c8-adce-d2bcb30d9ddc tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:22.487591 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-1b1a3b41-d851-48c8-adce-d2bcb30d9ddc tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:22.495264 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-1b1a3b41-d851-48c8-adce-d2bcb30d9ddc tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.152433 Jul 14 17:53:22.495845 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 132/220] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:22 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:53:22.542209 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-99ec479c-b41d-4e2c-b49c-8c7c5c0aa196 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:22.542813 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-99ec479c-b41d-4e2c-b49c-8c7c5c0aa196 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:22.549368 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-99ec479c-b41d-4e2c-b49c-8c7c5c0aa196 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:22.549810 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-99ec479c-b41d-4e2c-b49c-8c7c5c0aa196 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:22.550570 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-99ec479c-b41d-4e2c-b49c-8c7c5c0aa196 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:22.551003 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-99ec479c-b41d-4e2c-b49c-8c7c5c0aa196 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:22.680757 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-99ec479c-b41d-4e2c-b49c-8c7c5c0aa196 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:22.688531 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-99ec479c-b41d-4e2c-b49c-8c7c5c0aa196 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:22.690018 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-99ec479c-b41d-4e2c-b49c-8c7c5c0aa196 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:22.691120 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-99ec479c-b41d-4e2c-b49c-8c7c5c0aa196 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.152584 Jul 14 17:53:22.691676 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 133/221] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:53:22 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:53:22.713210 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-83f8dc55-e84f-4907-9998-247651530fdc tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:22.713906 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-83f8dc55-e84f-4907-9998-247651530fdc tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:22.720689 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-83f8dc55-e84f-4907-9998-247651530fdc tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:22.721024 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-83f8dc55-e84f-4907-9998-247651530fdc tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:22.721801 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-83f8dc55-e84f-4907-9998-247651530fdc tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:22.722241 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-83f8dc55-e84f-4907-9998-247651530fdc tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:22.852742 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-83f8dc55-e84f-4907-9998-247651530fdc tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:22.860218 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-83f8dc55-e84f-4907-9998-247651530fdc tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.150525 Jul 14 17:53:22.860791 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 134/222] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:22 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:53:23.512028 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-de7ea893-8fe6-4d5a-93d7-18afe863844f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:23.513319 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-de7ea893-8fe6-4d5a-93d7-18afe863844f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:23.519337 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-de7ea893-8fe6-4d5a-93d7-18afe863844f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:23.519827 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-de7ea893-8fe6-4d5a-93d7-18afe863844f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:23.520747 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-de7ea893-8fe6-4d5a-93d7-18afe863844f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:23.521267 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-de7ea893-8fe6-4d5a-93d7-18afe863844f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:23.647703 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-de7ea893-8fe6-4d5a-93d7-18afe863844f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:23.655757 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-de7ea893-8fe6-4d5a-93d7-18afe863844f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.147567 Jul 14 17:53:23.656354 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 135/223] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:23 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:53:23.708413 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-8f8f29b1-bd92-4d9b-baa6-deb52d7a82a1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:23.709027 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-8f8f29b1-bd92-4d9b-baa6-deb52d7a82a1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:23.714977 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8f8f29b1-bd92-4d9b-baa6-deb52d7a82a1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:23.715430 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8f8f29b1-bd92-4d9b-baa6-deb52d7a82a1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:23.716222 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8f8f29b1-bd92-4d9b-baa6-deb52d7a82a1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:23.716664 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8f8f29b1-bd92-4d9b-baa6-deb52d7a82a1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:23.846975 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-8f8f29b1-bd92-4d9b-baa6-deb52d7a82a1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:23.854928 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-8f8f29b1-bd92-4d9b-baa6-deb52d7a82a1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:23.856980 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-8f8f29b1-bd92-4d9b-baa6-deb52d7a82a1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:23.858077 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-8f8f29b1-bd92-4d9b-baa6-deb52d7a82a1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.153618 Jul 14 17:53:23.858632 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 136/224] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:53:23 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:53:23.876937 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-4523d293-6e7c-4d18-a32d-7d97cf5b5c43 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:23.877540 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-4523d293-6e7c-4d18-a32d-7d97cf5b5c43 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:23.883307 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4523d293-6e7c-4d18-a32d-7d97cf5b5c43 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:23.883745 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4523d293-6e7c-4d18-a32d-7d97cf5b5c43 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:23.884528 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4523d293-6e7c-4d18-a32d-7d97cf5b5c43 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:23.884955 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4523d293-6e7c-4d18-a32d-7d97cf5b5c43 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:24.010659 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-4523d293-6e7c-4d18-a32d-7d97cf5b5c43 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:24.018223 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-4523d293-6e7c-4d18-a32d-7d97cf5b5c43 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.144763 Jul 14 17:53:24.018734 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 137/225] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:23 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:53:24.673030 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-c463f310-3377-493b-9315-e40028301d4e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:24.673852 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-c463f310-3377-493b-9315-e40028301d4e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:24.679808 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c463f310-3377-493b-9315-e40028301d4e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:24.680296 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c463f310-3377-493b-9315-e40028301d4e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:24.681065 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c463f310-3377-493b-9315-e40028301d4e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:24.681504 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c463f310-3377-493b-9315-e40028301d4e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:24.814444 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-c463f310-3377-493b-9315-e40028301d4e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:24.822110 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-c463f310-3377-493b-9315-e40028301d4e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.153629 Jul 14 17:53:24.822671 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 138/226] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:24 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:53:24.876286 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-7fdae38e-5c6c-4f1a-aa47-c66973acb71c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:24.876899 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-7fdae38e-5c6c-4f1a-aa47-c66973acb71c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:24.883227 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7fdae38e-5c6c-4f1a-aa47-c66973acb71c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:24.883679 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7fdae38e-5c6c-4f1a-aa47-c66973acb71c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:24.884479 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7fdae38e-5c6c-4f1a-aa47-c66973acb71c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:24.884919 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7fdae38e-5c6c-4f1a-aa47-c66973acb71c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:25.010877 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-7fdae38e-5c6c-4f1a-aa47-c66973acb71c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:25.018721 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-7fdae38e-5c6c-4f1a-aa47-c66973acb71c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:25.020263 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-7fdae38e-5c6c-4f1a-aa47-c66973acb71c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:25.021362 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-7fdae38e-5c6c-4f1a-aa47-c66973acb71c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.149238 Jul 14 17:53:25.021918 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 139/227] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:53:24 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:53:25.034480 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-4143e5e1-c21a-4f77-b06a-f6a08b0263d3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:25.035105 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-4143e5e1-c21a-4f77-b06a-f6a08b0263d3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:25.040810 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4143e5e1-c21a-4f77-b06a-f6a08b0263d3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:25.041292 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4143e5e1-c21a-4f77-b06a-f6a08b0263d3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:25.042016 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4143e5e1-c21a-4f77-b06a-f6a08b0263d3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:25.042484 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4143e5e1-c21a-4f77-b06a-f6a08b0263d3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:25.170030 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-4143e5e1-c21a-4f77-b06a-f6a08b0263d3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:25.177333 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-4143e5e1-c21a-4f77-b06a-f6a08b0263d3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.146425 Jul 14 17:53:25.177908 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 140/228] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:25 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:53:25.839062 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-f6286581-af8f-4413-a47f-9f64d0116b5b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:25.839679 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-f6286581-af8f-4413-a47f-9f64d0116b5b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:25.845924 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f6286581-af8f-4413-a47f-9f64d0116b5b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:25.846375 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f6286581-af8f-4413-a47f-9f64d0116b5b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:25.847138 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f6286581-af8f-4413-a47f-9f64d0116b5b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:25.847577 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f6286581-af8f-4413-a47f-9f64d0116b5b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:25.974623 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-f6286581-af8f-4413-a47f-9f64d0116b5b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:25.982571 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-f6286581-af8f-4413-a47f-9f64d0116b5b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.147815 Jul 14 17:53:25.983137 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 141/229] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:25 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:26.039390 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-92060faa-e14a-4235-92d9-da2146a641a6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:26.040019 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-92060faa-e14a-4235-92d9-da2146a641a6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:26.046016 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-92060faa-e14a-4235-92d9-da2146a641a6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:26.046467 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-92060faa-e14a-4235-92d9-da2146a641a6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:26.047222 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-92060faa-e14a-4235-92d9-da2146a641a6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:26.047649 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-92060faa-e14a-4235-92d9-da2146a641a6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:26.192182 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-92060faa-e14a-4235-92d9-da2146a641a6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:26.200931 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-92060faa-e14a-4235-92d9-da2146a641a6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:26.202443 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-92060faa-e14a-4235-92d9-da2146a641a6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:26.203545 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-92060faa-e14a-4235-92d9-da2146a641a6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.168063 Jul 14 17:53:26.204163 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 142/230] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:53:26 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:53:26.208449 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-55d3c948-777e-452e-bef8-dfb5d996491c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:26.209052 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-55d3c948-777e-452e-bef8-dfb5d996491c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:26.214759 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-55d3c948-777e-452e-bef8-dfb5d996491c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:26.215214 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-55d3c948-777e-452e-bef8-dfb5d996491c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:26.216045 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-55d3c948-777e-452e-bef8-dfb5d996491c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:26.216484 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-55d3c948-777e-452e-bef8-dfb5d996491c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:26.341413 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-55d3c948-777e-452e-bef8-dfb5d996491c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:26.348820 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-55d3c948-777e-452e-bef8-dfb5d996491c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.143720 Jul 14 17:53:26.349385 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 143/231] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:26 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:26.999378 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-79e11412-923d-4ed2-b0af-6b23513a3511 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:27.000044 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-79e11412-923d-4ed2-b0af-6b23513a3511 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:27.006078 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-79e11412-923d-4ed2-b0af-6b23513a3511 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:27.006535 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-79e11412-923d-4ed2-b0af-6b23513a3511 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:27.007303 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-79e11412-923d-4ed2-b0af-6b23513a3511 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:27.007744 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-79e11412-923d-4ed2-b0af-6b23513a3511 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:27.144649 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-79e11412-923d-4ed2-b0af-6b23513a3511 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:27.152173 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-79e11412-923d-4ed2-b0af-6b23513a3511 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.156543 Jul 14 17:53:27.152745 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 144/232] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:26 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:53:27.221736 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-e68b4bbd-b97a-45c6-88f5-8e8fa349b71d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:27.222340 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-e68b4bbd-b97a-45c6-88f5-8e8fa349b71d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:27.229328 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e68b4bbd-b97a-45c6-88f5-8e8fa349b71d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:27.229842 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e68b4bbd-b97a-45c6-88f5-8e8fa349b71d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:27.230615 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e68b4bbd-b97a-45c6-88f5-8e8fa349b71d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:27.231048 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e68b4bbd-b97a-45c6-88f5-8e8fa349b71d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:27.376741 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-e68b4bbd-b97a-45c6-88f5-8e8fa349b71d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:27.384778 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-e68b4bbd-b97a-45c6-88f5-8e8fa349b71d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:27.386281 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-e68b4bbd-b97a-45c6-88f5-8e8fa349b71d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:27.387861 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-e68b4bbd-b97a-45c6-88f5-8e8fa349b71d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.169526 Jul 14 17:53:27.388606 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 145/233] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:53:27 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:53:27.392968 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-a72bd953-2ce3-492c-8de7-962d6cd6f771 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:27.393572 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-a72bd953-2ce3-492c-8de7-962d6cd6f771 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:27.406666 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a72bd953-2ce3-492c-8de7-962d6cd6f771 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:27.407112 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a72bd953-2ce3-492c-8de7-962d6cd6f771 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:27.407875 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a72bd953-2ce3-492c-8de7-962d6cd6f771 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:27.408380 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a72bd953-2ce3-492c-8de7-962d6cd6f771 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:27.538198 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-a72bd953-2ce3-492c-8de7-962d6cd6f771 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:27.545750 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-a72bd953-2ce3-492c-8de7-962d6cd6f771 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.156170 Jul 14 17:53:27.546327 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 146/234] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:27 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:28.169163 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-b0d9b2f5-1164-4118-b865-870931edca42 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:28.169782 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-b0d9b2f5-1164-4118-b865-870931edca42 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:28.175786 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b0d9b2f5-1164-4118-b865-870931edca42 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:28.176272 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b0d9b2f5-1164-4118-b865-870931edca42 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:28.177033 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b0d9b2f5-1164-4118-b865-870931edca42 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:28.177471 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b0d9b2f5-1164-4118-b865-870931edca42 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:28.304526 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-b0d9b2f5-1164-4118-b865-870931edca42 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:28.308021 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=100 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:53:28.313989 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-b0d9b2f5-1164-4118-b865-870931edca42 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.149136 Jul 14 17:53:28.314546 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 147/235] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:28 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:53:28.406364 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-849cdbba-2279-4538-83c8-7f2a2bd99a30 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:28.406923 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-849cdbba-2279-4538-83c8-7f2a2bd99a30 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:28.412832 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-849cdbba-2279-4538-83c8-7f2a2bd99a30 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:28.413282 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-849cdbba-2279-4538-83c8-7f2a2bd99a30 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:28.414036 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-849cdbba-2279-4538-83c8-7f2a2bd99a30 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:28.414469 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-849cdbba-2279-4538-83c8-7f2a2bd99a30 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:28.538985 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-849cdbba-2279-4538-83c8-7f2a2bd99a30 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:28.547554 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-849cdbba-2279-4538-83c8-7f2a2bd99a30 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:28.549085 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-849cdbba-2279-4538-83c8-7f2a2bd99a30 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:28.550191 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-849cdbba-2279-4538-83c8-7f2a2bd99a30 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.148271 Jul 14 17:53:28.550744 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 148/236] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:53:28 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:53:28.561908 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-11d0cff1-5610-48ae-abdd-9913bf7fad21 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:28.562510 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-11d0cff1-5610-48ae-abdd-9913bf7fad21 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:28.568535 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-11d0cff1-5610-48ae-abdd-9913bf7fad21 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:28.568989 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-11d0cff1-5610-48ae-abdd-9913bf7fad21 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:28.569751 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-11d0cff1-5610-48ae-abdd-9913bf7fad21 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:28.570196 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-11d0cff1-5610-48ae-abdd-9913bf7fad21 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:28.693627 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-11d0cff1-5610-48ae-abdd-9913bf7fad21 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:28.701166 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-11d0cff1-5610-48ae-abdd-9913bf7fad21 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.142653 Jul 14 17:53:28.701740 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 149/237] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:28 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:53:29.331624 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-2a7ac1da-2c87-466e-995a-0c7626225bb4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:29.332294 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-2a7ac1da-2c87-466e-995a-0c7626225bb4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:29.338403 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2a7ac1da-2c87-466e-995a-0c7626225bb4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:29.338854 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2a7ac1da-2c87-466e-995a-0c7626225bb4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:29.339624 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2a7ac1da-2c87-466e-995a-0c7626225bb4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:29.340095 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2a7ac1da-2c87-466e-995a-0c7626225bb4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:29.469223 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-2a7ac1da-2c87-466e-995a-0c7626225bb4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:29.476696 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-2a7ac1da-2c87-466e-995a-0c7626225bb4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.148985 Jul 14 17:53:29.477264 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 150/238] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:29 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:53:29.568125 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-5055a35d-d310-4d54-b715-f82ef2047284 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:29.568734 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-5055a35d-d310-4d54-b715-f82ef2047284 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:29.574659 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5055a35d-d310-4d54-b715-f82ef2047284 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:29.575109 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5055a35d-d310-4d54-b715-f82ef2047284 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:29.575874 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5055a35d-d310-4d54-b715-f82ef2047284 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:29.576339 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5055a35d-d310-4d54-b715-f82ef2047284 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:29.701915 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-5055a35d-d310-4d54-b715-f82ef2047284 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:29.709782 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-5055a35d-d310-4d54-b715-f82ef2047284 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:29.711257 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-5055a35d-d310-4d54-b715-f82ef2047284 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:29.712374 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-5055a35d-d310-4d54-b715-f82ef2047284 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.148426 Jul 14 17:53:29.712917 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 151/239] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:53:29 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:53:29.717185 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-1df3ea8f-40d5-43bf-afeb-6a22bf5e0499 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:29.717779 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-1df3ea8f-40d5-43bf-afeb-6a22bf5e0499 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:29.723353 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1df3ea8f-40d5-43bf-afeb-6a22bf5e0499 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:29.723795 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1df3ea8f-40d5-43bf-afeb-6a22bf5e0499 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:29.724586 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1df3ea8f-40d5-43bf-afeb-6a22bf5e0499 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:29.725015 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1df3ea8f-40d5-43bf-afeb-6a22bf5e0499 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:29.855944 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-1df3ea8f-40d5-43bf-afeb-6a22bf5e0499 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:29.863890 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-1df3ea8f-40d5-43bf-afeb-6a22bf5e0499 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.150038 Jul 14 17:53:29.864467 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 152/240] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:29 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:30.493333 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-0ae7b227-699e-4b47-864e-2b845abacf0a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:30.494002 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-0ae7b227-699e-4b47-864e-2b845abacf0a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:30.500462 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0ae7b227-699e-4b47-864e-2b845abacf0a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:30.500908 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0ae7b227-699e-4b47-864e-2b845abacf0a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:30.501658 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0ae7b227-699e-4b47-864e-2b845abacf0a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:30.502084 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0ae7b227-699e-4b47-864e-2b845abacf0a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:30.626141 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-0ae7b227-699e-4b47-864e-2b845abacf0a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:30.633439 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-0ae7b227-699e-4b47-864e-2b845abacf0a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.143906 Jul 14 17:53:30.633994 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 153/241] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:30 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:53:30.729894 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-276a6524-a3f4-4c33-8484-7b1e5c2bd941 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:30.730504 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-276a6524-a3f4-4c33-8484-7b1e5c2bd941 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:30.737189 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-276a6524-a3f4-4c33-8484-7b1e5c2bd941 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:30.737642 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-276a6524-a3f4-4c33-8484-7b1e5c2bd941 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:30.738446 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-276a6524-a3f4-4c33-8484-7b1e5c2bd941 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:30.738883 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-276a6524-a3f4-4c33-8484-7b1e5c2bd941 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:30.871853 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-276a6524-a3f4-4c33-8484-7b1e5c2bd941 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:30.879646 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-276a6524-a3f4-4c33-8484-7b1e5c2bd941 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:30.881158 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-276a6524-a3f4-4c33-8484-7b1e5c2bd941 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:30.882264 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-276a6524-a3f4-4c33-8484-7b1e5c2bd941 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.156174 Jul 14 17:53:30.882819 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 154/242] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:53:30 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:53:30.887143 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-993fbed0-f4ed-451b-a50a-e39434d17c24 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:30.887737 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-993fbed0-f4ed-451b-a50a-e39434d17c24 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:30.893899 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-993fbed0-f4ed-451b-a50a-e39434d17c24 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:30.894341 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-993fbed0-f4ed-451b-a50a-e39434d17c24 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:30.895089 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-993fbed0-f4ed-451b-a50a-e39434d17c24 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:30.895518 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-993fbed0-f4ed-451b-a50a-e39434d17c24 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:31.022946 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-993fbed0-f4ed-451b-a50a-e39434d17c24 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:31.030333 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-993fbed0-f4ed-451b-a50a-e39434d17c24 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.146590 Jul 14 17:53:31.030884 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 155/243] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:30 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:31.650672 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-454647bc-7069-4178-aa45-d30aa0715eda tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:31.651355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-454647bc-7069-4178-aa45-d30aa0715eda tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:31.657323 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-454647bc-7069-4178-aa45-d30aa0715eda tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:31.657770 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-454647bc-7069-4178-aa45-d30aa0715eda tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:31.658532 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-454647bc-7069-4178-aa45-d30aa0715eda tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:31.658969 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-454647bc-7069-4178-aa45-d30aa0715eda tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:31.784044 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-454647bc-7069-4178-aa45-d30aa0715eda tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:31.792252 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-454647bc-7069-4178-aa45-d30aa0715eda tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.145359 Jul 14 17:53:31.792832 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 156/244] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:31 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:53:31.900851 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-e47ac143-cfbb-48da-a599-f6f5974fe38e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:31.901398 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-e47ac143-cfbb-48da-a599-f6f5974fe38e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:31.907782 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e47ac143-cfbb-48da-a599-f6f5974fe38e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:31.908263 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e47ac143-cfbb-48da-a599-f6f5974fe38e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:31.909029 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e47ac143-cfbb-48da-a599-f6f5974fe38e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:31.909494 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e47ac143-cfbb-48da-a599-f6f5974fe38e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:32.209002 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-e47ac143-cfbb-48da-a599-f6f5974fe38e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:32.218818 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-e47ac143-cfbb-48da-a599-f6f5974fe38e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:32.220365 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-e47ac143-cfbb-48da-a599-f6f5974fe38e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:32.221481 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-e47ac143-cfbb-48da-a599-f6f5974fe38e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.324743 Jul 14 17:53:32.222038 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 157/245] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:53:31 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:53:32.226484 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-ad3294cd-6e45-4db3-8c9f-aa48cefc7413 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:32.227095 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-ad3294cd-6e45-4db3-8c9f-aa48cefc7413 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:32.233432 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ad3294cd-6e45-4db3-8c9f-aa48cefc7413 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:32.233898 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ad3294cd-6e45-4db3-8c9f-aa48cefc7413 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:32.234679 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ad3294cd-6e45-4db3-8c9f-aa48cefc7413 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:32.235119 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ad3294cd-6e45-4db3-8c9f-aa48cefc7413 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:32.362523 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-ad3294cd-6e45-4db3-8c9f-aa48cefc7413 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:32.369919 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-ad3294cd-6e45-4db3-8c9f-aa48cefc7413 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.146946 Jul 14 17:53:32.370477 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 158/246] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:32 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:32.808556 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-900d8b1b-0add-477f-86d0-bd1e1c438b98 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:32.809217 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-900d8b1b-0add-477f-86d0-bd1e1c438b98 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:32.811033 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_api:SELECT=100 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:53:32.816707 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-900d8b1b-0add-477f-86d0-bd1e1c438b98 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:32.817163 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-900d8b1b-0add-477f-86d0-bd1e1c438b98 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:32.818187 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-900d8b1b-0add-477f-86d0-bd1e1c438b98 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:32.818629 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-900d8b1b-0add-477f-86d0-bd1e1c438b98 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:32.947636 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-900d8b1b-0add-477f-86d0-bd1e1c438b98 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:32.955518 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-900d8b1b-0add-477f-86d0-bd1e1c438b98 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.150752 Jul 14 17:53:32.956103 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 159/247] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:32 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:53:33.241039 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-1d46a186-67af-4934-b415-9f4cb06272c0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:33.241797 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-1d46a186-67af-4934-b415-9f4cb06272c0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:33.248439 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1d46a186-67af-4934-b415-9f4cb06272c0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:33.249663 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1d46a186-67af-4934-b415-9f4cb06272c0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:33.250454 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1d46a186-67af-4934-b415-9f4cb06272c0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:33.251619 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1d46a186-67af-4934-b415-9f4cb06272c0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:33.396611 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-1d46a186-67af-4934-b415-9f4cb06272c0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:33.408486 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-1d46a186-67af-4934-b415-9f4cb06272c0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:33.410255 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-1d46a186-67af-4934-b415-9f4cb06272c0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:33.411667 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-1d46a186-67af-4934-b415-9f4cb06272c0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.175704 Jul 14 17:53:33.412240 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 160/248] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:53:33 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:53:33.416697 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-27611064-9d52-4b94-957d-0537b675a6c1 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:33.417305 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-27611064-9d52-4b94-957d-0537b675a6c1 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:33.425998 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-27611064-9d52-4b94-957d-0537b675a6c1 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:33.426455 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-27611064-9d52-4b94-957d-0537b675a6c1 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:33.427401 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-27611064-9d52-4b94-957d-0537b675a6c1 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:33.427665 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-27611064-9d52-4b94-957d-0537b675a6c1 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:33.552716 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-aca4b15c-3bd1-4fe1-84c6-1bf1cf15aaf1 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "POST /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 27.359552 Jul 14 17:53:33.553857 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 89/249] 10.222.0.64 () {60 vars in 1322 bytes} [Thu Jul 14 17:53:06 2022] POST /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b/os-volume_attachments => generated 194 bytes in 27361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:53:33.579915 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-27611064-9d52-4b94-957d-0537b675a6c1 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:33.587416 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-27611064-9d52-4b94-957d-0537b675a6c1 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.174212 Jul 14 17:53:33.588244 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 161/250] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:33 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:33.805563 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-ec47d68a-d6e0-42da-a9b2-3a6b939b2bb6 req-369b2be3-f4d3-431e-ab27-d03848e9a243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "323310aa-bd8a-4a21-9733-b1e73763a250", "name": "network-vif-plugged", "status": "completed", "tag": "bd30db4c-5dd9-4b56-9285-67801da2e116"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:53:33.816709 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-ec47d68a-d6e0-42da-a9b2-3a6b939b2bb6 req-369b2be3-f4d3-431e-ab27-d03848e9a243 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:33.817166 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-ec47d68a-d6e0-42da-a9b2-3a6b939b2bb6 req-369b2be3-f4d3-431e-ab27-d03848e9a243 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:33.829432 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-ec47d68a-d6e0-42da-a9b2-3a6b939b2bb6 req-369b2be3-f4d3-431e-ab27-d03848e9a243 service nova] Creating event network-vif-plugged:bd30db4c-5dd9-4b56-9285-67801da2e116 for instance 323310aa-bd8a-4a21-9733-b1e73763a250 on hv-cinder-84989 Jul 14 17:53:33.834890 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-ec47d68a-d6e0-42da-a9b2-3a6b939b2bb6 req-369b2be3-f4d3-431e-ab27-d03848e9a243 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033595 Jul 14 17:53:33.835864 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 90/251] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 17:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:53:33.971280 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-f9185e77-21a2-427d-84f1-b872df0c455a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:33.971895 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-f9185e77-21a2-427d-84f1-b872df0c455a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:33.978040 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f9185e77-21a2-427d-84f1-b872df0c455a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:33.978495 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f9185e77-21a2-427d-84f1-b872df0c455a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:33.979260 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f9185e77-21a2-427d-84f1-b872df0c455a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:33.979696 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f9185e77-21a2-427d-84f1-b872df0c455a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:34.114410 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-f9185e77-21a2-427d-84f1-b872df0c455a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:34.122201 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-f9185e77-21a2-427d-84f1-b872df0c455a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.154619 Jul 14 17:53:34.122836 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 162/252] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:33 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:34.430421 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-715b4bf7-14ae-4d29-aad1-22faff144d66 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:34.430421 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-715b4bf7-14ae-4d29-aad1-22faff144d66 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:34.437605 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-715b4bf7-14ae-4d29-aad1-22faff144d66 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:34.438084 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-715b4bf7-14ae-4d29-aad1-22faff144d66 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:34.438899 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-715b4bf7-14ae-4d29-aad1-22faff144d66 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:34.439465 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-715b4bf7-14ae-4d29-aad1-22faff144d66 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:34.581670 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-715b4bf7-14ae-4d29-aad1-22faff144d66 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:34.589745 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-715b4bf7-14ae-4d29-aad1-22faff144d66 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:34.591235 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-715b4bf7-14ae-4d29-aad1-22faff144d66 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:34.592392 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-715b4bf7-14ae-4d29-aad1-22faff144d66 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.167057 Jul 14 17:53:34.593232 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 91/253] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:53:34 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:53:34.604550 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-7954856a-af58-4808-b57f-de932dcf8958 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:34.605226 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-7954856a-af58-4808-b57f-de932dcf8958 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:34.611907 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7954856a-af58-4808-b57f-de932dcf8958 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:34.612384 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7954856a-af58-4808-b57f-de932dcf8958 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:34.613147 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7954856a-af58-4808-b57f-de932dcf8958 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:34.613729 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7954856a-af58-4808-b57f-de932dcf8958 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:34.781310 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-7954856a-af58-4808-b57f-de932dcf8958 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:34.789185 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-7954856a-af58-4808-b57f-de932dcf8958 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.188577 Jul 14 17:53:34.789875 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 163/254] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:34 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:35.138615 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-f85de7fc-9871-45aa-a58f-9d5eaca11758 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:35.139357 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-f85de7fc-9871-45aa-a58f-9d5eaca11758 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:35.146548 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f85de7fc-9871-45aa-a58f-9d5eaca11758 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:35.146979 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f85de7fc-9871-45aa-a58f-9d5eaca11758 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:35.147740 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f85de7fc-9871-45aa-a58f-9d5eaca11758 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:35.148204 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f85de7fc-9871-45aa-a58f-9d5eaca11758 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:35.283464 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-f85de7fc-9871-45aa-a58f-9d5eaca11758 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:35.291340 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-f85de7fc-9871-45aa-a58f-9d5eaca11758 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.156537 Jul 14 17:53:35.291919 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 92/255] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:35 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:35.611128 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-b870b10a-4d96-4dc7-ba0f-ee733d00430a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:35.611747 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-b870b10a-4d96-4dc7-ba0f-ee733d00430a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:35.617907 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b870b10a-4d96-4dc7-ba0f-ee733d00430a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:35.618557 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b870b10a-4d96-4dc7-ba0f-ee733d00430a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:35.619328 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b870b10a-4d96-4dc7-ba0f-ee733d00430a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:35.619772 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b870b10a-4d96-4dc7-ba0f-ee733d00430a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:35.638801 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=100 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:53:35.768618 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-b870b10a-4d96-4dc7-ba0f-ee733d00430a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:35.777342 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-b870b10a-4d96-4dc7-ba0f-ee733d00430a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:35.778861 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-b870b10a-4d96-4dc7-ba0f-ee733d00430a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:35.780037 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-b870b10a-4d96-4dc7-ba0f-ee733d00430a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.173432 Jul 14 17:53:35.781201 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 164/256] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:53:35 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:53:35.807866 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-10d94ae1-8f9f-4397-8346-76b1baf3de43 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:35.808599 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-10d94ae1-8f9f-4397-8346-76b1baf3de43 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:35.815564 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-10d94ae1-8f9f-4397-8346-76b1baf3de43 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:35.816181 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-10d94ae1-8f9f-4397-8346-76b1baf3de43 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:35.817027 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-10d94ae1-8f9f-4397-8346-76b1baf3de43 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:35.817542 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-10d94ae1-8f9f-4397-8346-76b1baf3de43 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:35.968597 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-10d94ae1-8f9f-4397-8346-76b1baf3de43 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:35.975810 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-10d94ae1-8f9f-4397-8346-76b1baf3de43 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1362 microversion: 2.1 time: 0.172930 Jul 14 17:53:35.976541 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 93/257] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:35 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:36.313800 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-e79f013a-a61b-47ff-9ae1-3728b42fe0d4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:36.314665 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-e79f013a-a61b-47ff-9ae1-3728b42fe0d4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:36.322701 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e79f013a-a61b-47ff-9ae1-3728b42fe0d4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:36.323158 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e79f013a-a61b-47ff-9ae1-3728b42fe0d4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:36.324147 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e79f013a-a61b-47ff-9ae1-3728b42fe0d4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:36.324665 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e79f013a-a61b-47ff-9ae1-3728b42fe0d4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:36.530952 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-e79f013a-a61b-47ff-9ae1-3728b42fe0d4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:36.545852 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-e79f013a-a61b-47ff-9ae1-3728b42fe0d4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.239815 Jul 14 17:53:36.547251 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 165/258] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:36 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:36.803053 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-8ed3b325-0571-4def-ab67-1d3ab5f36900 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:36.809107 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-8ed3b325-0571-4def-ab67-1d3ab5f36900 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:36.819146 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8ed3b325-0571-4def-ab67-1d3ab5f36900 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:36.820196 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8ed3b325-0571-4def-ab67-1d3ab5f36900 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:36.821547 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8ed3b325-0571-4def-ab67-1d3ab5f36900 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:36.823523 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8ed3b325-0571-4def-ab67-1d3ab5f36900 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:36.993746 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-c7fb40e6-a539-48b6-a548-2e71035d3bb6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:36.994845 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-c7fb40e6-a539-48b6-a548-2e71035d3bb6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:37.007244 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c7fb40e6-a539-48b6-a548-2e71035d3bb6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:37.007698 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c7fb40e6-a539-48b6-a548-2e71035d3bb6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:37.008504 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c7fb40e6-a539-48b6-a548-2e71035d3bb6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:37.008937 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c7fb40e6-a539-48b6-a548-2e71035d3bb6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:37.185349 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-8ed3b325-0571-4def-ab67-1d3ab5f36900 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:37.196864 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-8ed3b325-0571-4def-ab67-1d3ab5f36900 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:37.198674 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-8ed3b325-0571-4def-ab67-1d3ab5f36900 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:37.200656 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-8ed3b325-0571-4def-ab67-1d3ab5f36900 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.403430 Jul 14 17:53:37.201821 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 94/259] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:53:36 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:53:37.258668 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-c7fb40e6-a539-48b6-a548-2e71035d3bb6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:37.270053 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-c7fb40e6-a539-48b6-a548-2e71035d3bb6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1548 microversion: 2.1 time: 0.280552 Jul 14 17:53:37.270639 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 166/260] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:36 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1548 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:53:37.287431 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-651abfef-3279-4e15-a09b-26febae1703c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:37.287944 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-651abfef-3279-4e15-a09b-26febae1703c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:37.294239 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-651abfef-3279-4e15-a09b-26febae1703c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:37.294777 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-651abfef-3279-4e15-a09b-26febae1703c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:37.295556 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-651abfef-3279-4e15-a09b-26febae1703c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:37.296085 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-651abfef-3279-4e15-a09b-26febae1703c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:37.373254 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-651abfef-3279-4e15-a09b-26febae1703c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089582 Jul 14 17:53:37.374840 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 95/261] 10.222.0.64 () {58 vars in 1274 bytes} [Thu Jul 14 17:53:37 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:53:37.564409 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-4a169ad3-2417-45ac-bd9d-374cdbff3cc9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:37.565295 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-4a169ad3-2417-45ac-bd9d-374cdbff3cc9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:37.574343 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4a169ad3-2417-45ac-bd9d-374cdbff3cc9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:37.575034 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4a169ad3-2417-45ac-bd9d-374cdbff3cc9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:37.576630 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4a169ad3-2417-45ac-bd9d-374cdbff3cc9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:37.577270 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4a169ad3-2417-45ac-bd9d-374cdbff3cc9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:37.850286 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-4a169ad3-2417-45ac-bd9d-374cdbff3cc9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:37.857621 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-4a169ad3-2417-45ac-bd9d-374cdbff3cc9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.298369 Jul 14 17:53:37.858193 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 167/262] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:37 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:38.220034 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-6fb60ac4-1375-4c1a-8aa2-1ad50633faf6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:38.220650 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-6fb60ac4-1375-4c1a-8aa2-1ad50633faf6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:38.230339 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6fb60ac4-1375-4c1a-8aa2-1ad50633faf6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:38.231286 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6fb60ac4-1375-4c1a-8aa2-1ad50633faf6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:38.232294 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6fb60ac4-1375-4c1a-8aa2-1ad50633faf6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:38.232946 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6fb60ac4-1375-4c1a-8aa2-1ad50633faf6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:38.518741 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-6fb60ac4-1375-4c1a-8aa2-1ad50633faf6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:38.563519 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-6fb60ac4-1375-4c1a-8aa2-1ad50633faf6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:38.571497 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-6fb60ac4-1375-4c1a-8aa2-1ad50633faf6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:38.574414 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-6fb60ac4-1375-4c1a-8aa2-1ad50633faf6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.359221 Jul 14 17:53:38.577659 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 96/263] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:53:38 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:53:38.875223 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-6139739d-cadb-47cc-bca9-eae5137ef76b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:38.875826 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-6139739d-cadb-47cc-bca9-eae5137ef76b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:38.885733 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6139739d-cadb-47cc-bca9-eae5137ef76b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:38.886179 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6139739d-cadb-47cc-bca9-eae5137ef76b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:38.886950 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6139739d-cadb-47cc-bca9-eae5137ef76b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:38.887380 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6139739d-cadb-47cc-bca9-eae5137ef76b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:39.041256 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-6139739d-cadb-47cc-bca9-eae5137ef76b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:39.050420 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-6139739d-cadb-47cc-bca9-eae5137ef76b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.179484 Jul 14 17:53:39.051203 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 168/264] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:38 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:39.223839 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-fd0539ef-cc4b-4c8b-8551-94ae7d31afec req-7c59564c-a338-4b10-99c0-77b0e28ad9dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e8e31fc-eea3-4666-90e3-1898f92cf6ba", "tag": "b2e39af7-f885-4b8c-8d62-c542f2b4d4e2"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:53:39.240035 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-fd0539ef-cc4b-4c8b-8551-94ae7d31afec req-7c59564c-a338-4b10-99c0-77b0e28ad9dd service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:39.250982 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-fd0539ef-cc4b-4c8b-8551-94ae7d31afec req-7c59564c-a338-4b10-99c0-77b0e28ad9dd service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:39.263588 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-fd0539ef-cc4b-4c8b-8551-94ae7d31afec req-7c59564c-a338-4b10-99c0-77b0e28ad9dd service nova] Creating event network-changed:b2e39af7-f885-4b8c-8d62-c542f2b4d4e2 for instance 1e8e31fc-eea3-4666-90e3-1898f92cf6ba on hv-cinder-84989 Jul 14 17:53:39.270489 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-fd0539ef-cc4b-4c8b-8551-94ae7d31afec req-7c59564c-a338-4b10-99c0-77b0e28ad9dd service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051005 Jul 14 17:53:39.271714 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 97/265] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 17:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:53:39.596532 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-529ac0c2-09cf-4c39-b015-bf40e0de82d1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:39.597140 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-529ac0c2-09cf-4c39-b015-bf40e0de82d1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:39.603552 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-529ac0c2-09cf-4c39-b015-bf40e0de82d1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:39.604038 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-529ac0c2-09cf-4c39-b015-bf40e0de82d1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:39.604994 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-529ac0c2-09cf-4c39-b015-bf40e0de82d1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:39.605437 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-529ac0c2-09cf-4c39-b015-bf40e0de82d1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:39.799318 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-529ac0c2-09cf-4c39-b015-bf40e0de82d1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:39.807748 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-529ac0c2-09cf-4c39-b015-bf40e0de82d1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:39.809678 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-529ac0c2-09cf-4c39-b015-bf40e0de82d1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:39.810965 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-529ac0c2-09cf-4c39-b015-bf40e0de82d1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.220314 Jul 14 17:53:39.811966 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 169/266] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:53:39 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:53:40.068062 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-0818b550-de09-464a-acf1-78ffec65445f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:40.069024 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-0818b550-de09-464a-acf1-78ffec65445f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:40.084162 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0818b550-de09-464a-acf1-78ffec65445f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:40.086310 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0818b550-de09-464a-acf1-78ffec65445f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:40.088154 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0818b550-de09-464a-acf1-78ffec65445f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:40.091618 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0818b550-de09-464a-acf1-78ffec65445f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:40.361024 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-0818b550-de09-464a-acf1-78ffec65445f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:40.373120 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-0818b550-de09-464a-acf1-78ffec65445f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.306115 Jul 14 17:53:40.374682 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 98/267] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:40 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:40.829345 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-2e5c208b-9c4b-481c-882f-e9ee036f4dc5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:40.829805 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-2e5c208b-9c4b-481c-882f-e9ee036f4dc5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:40.836055 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2e5c208b-9c4b-481c-882f-e9ee036f4dc5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:40.836709 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2e5c208b-9c4b-481c-882f-e9ee036f4dc5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:40.837477 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2e5c208b-9c4b-481c-882f-e9ee036f4dc5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:40.838079 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2e5c208b-9c4b-481c-882f-e9ee036f4dc5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:40.973641 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-2e5c208b-9c4b-481c-882f-e9ee036f4dc5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:40.981623 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-2e5c208b-9c4b-481c-882f-e9ee036f4dc5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:40.983135 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-2e5c208b-9c4b-481c-882f-e9ee036f4dc5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:40.984962 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-2e5c208b-9c4b-481c-882f-e9ee036f4dc5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.159650 Jul 14 17:53:40.986806 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 170/268] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:53:40 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:53:41.390528 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-0b6ef635-b9b3-43d5-bd27-8394663e641b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:41.391821 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-0b6ef635-b9b3-43d5-bd27-8394663e641b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:41.398576 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0b6ef635-b9b3-43d5-bd27-8394663e641b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:41.399255 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0b6ef635-b9b3-43d5-bd27-8394663e641b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:41.399895 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0b6ef635-b9b3-43d5-bd27-8394663e641b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:41.400471 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0b6ef635-b9b3-43d5-bd27-8394663e641b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:41.598995 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-0b6ef635-b9b3-43d5-bd27-8394663e641b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:41.606975 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-0b6ef635-b9b3-43d5-bd27-8394663e641b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.220832 Jul 14 17:53:41.607733 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 99/269] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:41 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:42.004229 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-90f21a3c-70b8-4b50-bec9-f0b3f38fa755 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:42.004766 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-90f21a3c-70b8-4b50-bec9-f0b3f38fa755 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:42.010685 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-90f21a3c-70b8-4b50-bec9-f0b3f38fa755 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:42.011135 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-90f21a3c-70b8-4b50-bec9-f0b3f38fa755 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:42.011893 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-90f21a3c-70b8-4b50-bec9-f0b3f38fa755 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:42.012352 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-90f21a3c-70b8-4b50-bec9-f0b3f38fa755 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:42.176602 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-90f21a3c-70b8-4b50-bec9-f0b3f38fa755 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:42.186654 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-90f21a3c-70b8-4b50-bec9-f0b3f38fa755 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:42.189204 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-90f21a3c-70b8-4b50-bec9-f0b3f38fa755 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:42.190364 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-90f21a3c-70b8-4b50-bec9-f0b3f38fa755 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1407 microversion: 2.20 time: 0.190665 Jul 14 17:53:42.190929 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 171/270] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:53:41 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:53:42.623762 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-45c6c610-8dcb-468a-afc0-a79f03a8941f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:42.625001 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-45c6c610-8dcb-468a-afc0-a79f03a8941f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:42.631187 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-45c6c610-8dcb-468a-afc0-a79f03a8941f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:42.631630 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-45c6c610-8dcb-468a-afc0-a79f03a8941f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:42.632417 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-45c6c610-8dcb-468a-afc0-a79f03a8941f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:42.632852 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-45c6c610-8dcb-468a-afc0-a79f03a8941f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:42.803593 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-45c6c610-8dcb-468a-afc0-a79f03a8941f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:42.811328 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-45c6c610-8dcb-468a-afc0-a79f03a8941f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.191276 Jul 14 17:53:42.811903 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 100/271] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:42 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:43.208359 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-8bad1bb5-bf37-4304-98c3-cb7eecf51ede tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:43.208958 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-8bad1bb5-bf37-4304-98c3-cb7eecf51ede tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:43.215302 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8bad1bb5-bf37-4304-98c3-cb7eecf51ede tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:43.215750 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8bad1bb5-bf37-4304-98c3-cb7eecf51ede tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:43.216539 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8bad1bb5-bf37-4304-98c3-cb7eecf51ede tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:43.216971 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8bad1bb5-bf37-4304-98c3-cb7eecf51ede tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:43.405358 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-8bad1bb5-bf37-4304-98c3-cb7eecf51ede tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:43.414417 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-8bad1bb5-bf37-4304-98c3-cb7eecf51ede tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:43.416076 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-8bad1bb5-bf37-4304-98c3-cb7eecf51ede tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:43.417464 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-8bad1bb5-bf37-4304-98c3-cb7eecf51ede tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1600 microversion: 2.20 time: 0.213075 Jul 14 17:53:43.418216 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 172/272] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:53:43 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1600 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:53:43.443276 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-5581a909-5d29-46c8-b916-4e91bd73569a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:43.443716 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-5581a909-5d29-46c8-b916-4e91bd73569a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:43.450516 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5581a909-5d29-46c8-b916-4e91bd73569a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:43.451963 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5581a909-5d29-46c8-b916-4e91bd73569a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:43.452845 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5581a909-5d29-46c8-b916-4e91bd73569a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:43.453299 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5581a909-5d29-46c8-b916-4e91bd73569a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:43.542038 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-5581a909-5d29-46c8-b916-4e91bd73569a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.106903 Jul 14 17:53:43.542992 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 101/273] 10.222.0.64 () {60 vars in 1315 bytes} [Thu Jul 14 17:53:43 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 17:53:43.840016 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-c58f3469-a36e-444b-8717-ef1d4c97683a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:43.841761 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-c58f3469-a36e-444b-8717-ef1d4c97683a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:43.853841 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c58f3469-a36e-444b-8717-ef1d4c97683a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:43.857124 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c58f3469-a36e-444b-8717-ef1d4c97683a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:43.858658 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c58f3469-a36e-444b-8717-ef1d4c97683a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:43.859231 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c58f3469-a36e-444b-8717-ef1d4c97683a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:43.965587 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-9a79de85-d53b-49e3-a630-723379f680be req-e3bc5605-f75a-429c-a17c-13b9863da35c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8687636-908e-466b-b6dc-3a3e607debb1", "name": "network-vif-plugged", "status": "completed", "tag": "6c1c53f4-2ce6-4875-9196-03a35b5f13c4"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:53:43.977522 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-9a79de85-d53b-49e3-a630-723379f680be req-e3bc5605-f75a-429c-a17c-13b9863da35c service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:43.977996 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-9a79de85-d53b-49e3-a630-723379f680be req-e3bc5605-f75a-429c-a17c-13b9863da35c service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:43.990177 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-9a79de85-d53b-49e3-a630-723379f680be req-e3bc5605-f75a-429c-a17c-13b9863da35c service nova] Creating event network-vif-plugged:6c1c53f4-2ce6-4875-9196-03a35b5f13c4 for instance d8687636-908e-466b-b6dc-3a3e607debb1 on hv-cinder-84989 Jul 14 17:53:43.995395 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-9a79de85-d53b-49e3-a630-723379f680be req-e3bc5605-f75a-429c-a17c-13b9863da35c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033427 Jul 14 17:53:43.996555 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 102/274] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 17:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 17:53:44.038323 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-c58f3469-a36e-444b-8717-ef1d4c97683a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:44.048873 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-c58f3469-a36e-444b-8717-ef1d4c97683a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.220425 Jul 14 17:53:44.050113 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 173/275] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:43 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:44.969302 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-d7c72677-938c-4156-a45e-94a17add8b50 req-65b76757-1a53-423d-b490-1d29c0316f51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afa45fb8-7566-483d-95ce-8f0242138b17", "tag": "babcf3c4-dfb9-4f4a-a0d8-6a98c8a91d00"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:53:44.978797 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-d7c72677-938c-4156-a45e-94a17add8b50 req-65b76757-1a53-423d-b490-1d29c0316f51 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:44.979243 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-d7c72677-938c-4156-a45e-94a17add8b50 req-65b76757-1a53-423d-b490-1d29c0316f51 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:44.991486 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-d7c72677-938c-4156-a45e-94a17add8b50 req-65b76757-1a53-423d-b490-1d29c0316f51 service nova] Creating event network-changed:babcf3c4-dfb9-4f4a-a0d8-6a98c8a91d00 for instance afa45fb8-7566-483d-95ce-8f0242138b17 on hv-cinder-84989 Jul 14 17:53:44.996506 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-d7c72677-938c-4156-a45e-94a17add8b50 req-65b76757-1a53-423d-b490-1d29c0316f51 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031711 Jul 14 17:53:44.997104 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 103/276] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 17:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:53:45.068336 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-02b0a450-00c2-4f9a-8258-455bb928644a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:45.069847 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-02b0a450-00c2-4f9a-8258-455bb928644a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:45.077008 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-02b0a450-00c2-4f9a-8258-455bb928644a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:45.077459 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-02b0a450-00c2-4f9a-8258-455bb928644a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:45.078295 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-02b0a450-00c2-4f9a-8258-455bb928644a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:45.078736 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-02b0a450-00c2-4f9a-8258-455bb928644a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:45.222680 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-02b0a450-00c2-4f9a-8258-455bb928644a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:45.230329 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-02b0a450-00c2-4f9a-8258-455bb928644a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.168022 Jul 14 17:53:45.231075 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 174/277] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:45 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:46.248814 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-3552ebef-c8db-4d63-8d8d-52d34deface6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:46.249509 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-3552ebef-c8db-4d63-8d8d-52d34deface6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:46.256398 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3552ebef-c8db-4d63-8d8d-52d34deface6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:46.256847 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3552ebef-c8db-4d63-8d8d-52d34deface6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:46.257608 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3552ebef-c8db-4d63-8d8d-52d34deface6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:46.258047 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3552ebef-c8db-4d63-8d8d-52d34deface6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:46.391209 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-3552ebef-c8db-4d63-8d8d-52d34deface6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:46.398686 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-3552ebef-c8db-4d63-8d8d-52d34deface6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.154672 Jul 14 17:53:46.399255 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 104/278] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:46 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:47.415487 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-21685697-4281-4e57-98a5-c4610cd6946b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:47.416126 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-21685697-4281-4e57-98a5-c4610cd6946b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:47.422320 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-21685697-4281-4e57-98a5-c4610cd6946b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:47.422776 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-21685697-4281-4e57-98a5-c4610cd6946b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:47.423540 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-21685697-4281-4e57-98a5-c4610cd6946b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:47.424012 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-21685697-4281-4e57-98a5-c4610cd6946b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:47.553692 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-21685697-4281-4e57-98a5-c4610cd6946b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:47.561377 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-21685697-4281-4e57-98a5-c4610cd6946b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.149858 Jul 14 17:53:47.561949 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 175/279] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:47 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:48.579090 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-5f544abd-0d7a-4b59-b78f-fd4560784033 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:48.579597 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-5f544abd-0d7a-4b59-b78f-fd4560784033 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:48.586301 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5f544abd-0d7a-4b59-b78f-fd4560784033 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:48.586746 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5f544abd-0d7a-4b59-b78f-fd4560784033 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:48.587493 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5f544abd-0d7a-4b59-b78f-fd4560784033 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:48.587943 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5f544abd-0d7a-4b59-b78f-fd4560784033 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:48.717849 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-5f544abd-0d7a-4b59-b78f-fd4560784033 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:48.725933 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-5f544abd-0d7a-4b59-b78f-fd4560784033 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.150805 Jul 14 17:53:48.726502 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 105/280] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:48 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:49.742563 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-adf94e2d-7697-4e15-8369-78c9757407fa tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:49.743173 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-adf94e2d-7697-4e15-8369-78c9757407fa tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:49.749296 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-adf94e2d-7697-4e15-8369-78c9757407fa tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:49.749753 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-adf94e2d-7697-4e15-8369-78c9757407fa tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:49.751096 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-adf94e2d-7697-4e15-8369-78c9757407fa tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:49.751531 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-adf94e2d-7697-4e15-8369-78c9757407fa tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:49.886780 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-adf94e2d-7697-4e15-8369-78c9757407fa tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:49.894407 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-adf94e2d-7697-4e15-8369-78c9757407fa tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.155682 Jul 14 17:53:49.894972 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 176/281] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:49 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:50.910694 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-a09e71ec-8c64-4890-8b6c-2b65986f59ee tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:50.911310 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-a09e71ec-8c64-4890-8b6c-2b65986f59ee tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:50.917970 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a09e71ec-8c64-4890-8b6c-2b65986f59ee tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:50.918417 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a09e71ec-8c64-4890-8b6c-2b65986f59ee tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:50.919182 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a09e71ec-8c64-4890-8b6c-2b65986f59ee tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:50.919653 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a09e71ec-8c64-4890-8b6c-2b65986f59ee tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:51.048384 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-a09e71ec-8c64-4890-8b6c-2b65986f59ee tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:51.055724 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-a09e71ec-8c64-4890-8b6c-2b65986f59ee tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1322 microversion: 2.1 time: 0.148810 Jul 14 17:53:51.056346 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 106/282] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:50 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:52.075315 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-e445db88-5b0f-43a0-841b-a80f0588355d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:52.075945 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-e445db88-5b0f-43a0-841b-a80f0588355d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:52.081911 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e445db88-5b0f-43a0-841b-a80f0588355d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:52.082357 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e445db88-5b0f-43a0-841b-a80f0588355d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:52.083116 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e445db88-5b0f-43a0-841b-a80f0588355d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:52.083548 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e445db88-5b0f-43a0-841b-a80f0588355d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:52.250487 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-e445db88-5b0f-43a0-841b-a80f0588355d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:52.258217 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-e445db88-5b0f-43a0-841b-a80f0588355d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1515 microversion: 2.1 time: 0.186596 Jul 14 17:53:52.258785 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 177/283] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:52 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:52.275539 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-0c5ae399-64e0-4a70-90be-adc166694d8e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:53:52.276529 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-0c5ae399-64e0-4a70-90be-adc166694d8e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:52.283719 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0c5ae399-64e0-4a70-90be-adc166694d8e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:52.284208 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0c5ae399-64e0-4a70-90be-adc166694d8e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:52.284979 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0c5ae399-64e0-4a70-90be-adc166694d8e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:52.285416 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0c5ae399-64e0-4a70-90be-adc166694d8e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:52.308275 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.objects.instance [None req-0c5ae399-64e0-4a70-90be-adc166694d8e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lazy-loading 'flavor' on Instance uuid d8687636-908e-466b-b6dc-3a3e607debb1 {{(pid=129470) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 17:53:52.373206 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:53:52.435079 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-0c5ae399-64e0-4a70-90be-adc166694d8e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "POST /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1/action" status: 200 len: 32 microversion: 2.1 time: 0.163495 Jul 14 17:53:52.435625 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 107/284] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Jul 14 17:53:52 2022] POST /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1/action => generated 32 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 17:53:52.445030 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-4c6e132b-e8ea-4a6a-922c-0301fc971170 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:52.445657 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-4c6e132b-e8ea-4a6a-922c-0301fc971170 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:52.451585 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4c6e132b-e8ea-4a6a-922c-0301fc971170 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:52.452073 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4c6e132b-e8ea-4a6a-922c-0301fc971170 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:52.452843 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4c6e132b-e8ea-4a6a-922c-0301fc971170 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:52.453826 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4c6e132b-e8ea-4a6a-922c-0301fc971170 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:52.591195 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-4c6e132b-e8ea-4a6a-922c-0301fc971170 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:52.599431 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-4c6e132b-e8ea-4a6a-922c-0301fc971170 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.158556 Jul 14 17:53:52.600017 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 178/285] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:52 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:53.618952 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-5211f6da-d943-4b28-adf9-94f79f18020c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:53.619687 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-5211f6da-d943-4b28-adf9-94f79f18020c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:53.627048 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5211f6da-d943-4b28-adf9-94f79f18020c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:53.627498 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5211f6da-d943-4b28-adf9-94f79f18020c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:53.628326 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5211f6da-d943-4b28-adf9-94f79f18020c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:53.628765 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5211f6da-d943-4b28-adf9-94f79f18020c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:53.773495 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-5211f6da-d943-4b28-adf9-94f79f18020c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:53.780904 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-5211f6da-d943-4b28-adf9-94f79f18020c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.167299 Jul 14 17:53:53.781965 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 108/286] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:53 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:54.799280 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-2044842f-e395-4760-9114-5de6dd04e7c0 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:54.799946 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-2044842f-e395-4760-9114-5de6dd04e7c0 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:54.806427 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2044842f-e395-4760-9114-5de6dd04e7c0 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:54.806924 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2044842f-e395-4760-9114-5de6dd04e7c0 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:54.807793 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2044842f-e395-4760-9114-5de6dd04e7c0 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:54.808425 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2044842f-e395-4760-9114-5de6dd04e7c0 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:54.953643 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-2044842f-e395-4760-9114-5de6dd04e7c0 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:54.961888 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-2044842f-e395-4760-9114-5de6dd04e7c0 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.167722 Jul 14 17:53:54.962625 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 179/287] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:54 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:55.978693 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-364a21f8-d458-4685-bb27-eb3828690e94 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:55.981442 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-364a21f8-d458-4685-bb27-eb3828690e94 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:56.003220 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-364a21f8-d458-4685-bb27-eb3828690e94 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:56.003679 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-364a21f8-d458-4685-bb27-eb3828690e94 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:56.004487 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-364a21f8-d458-4685-bb27-eb3828690e94 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:56.004917 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-364a21f8-d458-4685-bb27-eb3828690e94 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:56.202409 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-364a21f8-d458-4685-bb27-eb3828690e94 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:56.211911 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-364a21f8-d458-4685-bb27-eb3828690e94 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.237063 Jul 14 17:53:56.213170 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 109/288] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:55 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:57.237444 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-e3a2e6d8-fe22-48cd-9076-d64ff6ce05c0 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:57.240587 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-e3a2e6d8-fe22-48cd-9076-d64ff6ce05c0 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:57.250576 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e3a2e6d8-fe22-48cd-9076-d64ff6ce05c0 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:57.251952 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e3a2e6d8-fe22-48cd-9076-d64ff6ce05c0 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:57.254802 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e3a2e6d8-fe22-48cd-9076-d64ff6ce05c0 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:57.255915 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e3a2e6d8-fe22-48cd-9076-d64ff6ce05c0 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:57.549406 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-e3a2e6d8-fe22-48cd-9076-d64ff6ce05c0 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:57.560482 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-e3a2e6d8-fe22-48cd-9076-d64ff6ce05c0 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.332172 Jul 14 17:53:57.561074 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 180/289] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:57 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:58.577690 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-851a7264-27bb-4d13-ba91-88dc65cac24c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:58.579453 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-851a7264-27bb-4d13-ba91-88dc65cac24c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:58.586331 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_api:SELECT=41 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:53:58.588476 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-851a7264-27bb-4d13-ba91-88dc65cac24c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:58.588982 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-851a7264-27bb-4d13-ba91-88dc65cac24c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:58.590096 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-851a7264-27bb-4d13-ba91-88dc65cac24c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:58.590678 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-851a7264-27bb-4d13-ba91-88dc65cac24c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:58.770535 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-851a7264-27bb-4d13-ba91-88dc65cac24c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:58.779314 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-851a7264-27bb-4d13-ba91-88dc65cac24c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.205443 Jul 14 17:53:58.779913 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 110/290] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:58 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:53:59.796123 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-91988175-8b06-4f8b-af92-26bcfce4ae95 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:53:59.796717 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-91988175-8b06-4f8b-af92-26bcfce4ae95 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:53:59.803394 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-91988175-8b06-4f8b-af92-26bcfce4ae95 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:59.803918 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-91988175-8b06-4f8b-af92-26bcfce4ae95 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:59.804775 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-91988175-8b06-4f8b-af92-26bcfce4ae95 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:53:59.805377 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-91988175-8b06-4f8b-af92-26bcfce4ae95 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:53:59.809493 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=100 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:53:59.949461 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-91988175-8b06-4f8b-af92-26bcfce4ae95 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:53:59.957487 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-91988175-8b06-4f8b-af92-26bcfce4ae95 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.165177 Jul 14 17:53:59.958058 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 181/291] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:53:59 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:00.974865 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-4b5934f5-8aaf-4049-b334-46edc3c2898c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:00.975549 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-4b5934f5-8aaf-4049-b334-46edc3c2898c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:00.982061 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4b5934f5-8aaf-4049-b334-46edc3c2898c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:00.982516 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4b5934f5-8aaf-4049-b334-46edc3c2898c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:00.983273 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4b5934f5-8aaf-4049-b334-46edc3c2898c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:00.983715 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4b5934f5-8aaf-4049-b334-46edc3c2898c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:01.120531 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-4b5934f5-8aaf-4049-b334-46edc3c2898c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:01.128630 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-4b5934f5-8aaf-4049-b334-46edc3c2898c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.158423 Jul 14 17:54:01.129203 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 111/292] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:00 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:01.175517 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-06ed26b9-ef3d-4b0e-bfaf-88a20299a77d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:01.176155 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-06ed26b9-ef3d-4b0e-bfaf-88a20299a77d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:01.182077 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-06ed26b9-ef3d-4b0e-bfaf-88a20299a77d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:01.182525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-06ed26b9-ef3d-4b0e-bfaf-88a20299a77d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:01.183292 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-06ed26b9-ef3d-4b0e-bfaf-88a20299a77d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:01.183731 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-06ed26b9-ef3d-4b0e-bfaf-88a20299a77d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:01.209683 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-06ed26b9-ef3d-4b0e-bfaf-88a20299a77d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Going to try to terminate instance {{(pid=129471) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 17:54:01.338470 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-06ed26b9-ef3d-4b0e-bfaf-88a20299a77d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "DELETE /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 204 len: 0 microversion: 2.1 time: 0.166474 Jul 14 17:54:01.339247 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 182/293] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Jul 14 17:54:01 2022] DELETE /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 17:54:01.347336 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-da57fc33-2f0c-4d4d-ab3a-d745363a5e2b tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:01.347965 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-da57fc33-2f0c-4d4d-ab3a-d745363a5e2b tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:01.353988 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-da57fc33-2f0c-4d4d-ab3a-d745363a5e2b tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:01.354439 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-da57fc33-2f0c-4d4d-ab3a-d745363a5e2b tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:01.355196 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-da57fc33-2f0c-4d4d-ab3a-d745363a5e2b tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:01.355629 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-da57fc33-2f0c-4d4d-ab3a-d745363a5e2b tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:01.493332 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-da57fc33-2f0c-4d4d-ab3a-d745363a5e2b tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:01.501926 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-da57fc33-2f0c-4d4d-ab3a-d745363a5e2b tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1554 microversion: 2.1 time: 0.158457 Jul 14 17:54:01.502685 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 112/294] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:01 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:54:02.146914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-0f8dac76-1e89-4973-b31f-6bc6b7af84e7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:02.147677 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-0f8dac76-1e89-4973-b31f-6bc6b7af84e7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:02.154803 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0f8dac76-1e89-4973-b31f-6bc6b7af84e7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:02.155296 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0f8dac76-1e89-4973-b31f-6bc6b7af84e7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:02.156210 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0f8dac76-1e89-4973-b31f-6bc6b7af84e7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:02.156716 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0f8dac76-1e89-4973-b31f-6bc6b7af84e7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:02.485965 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-0f8dac76-1e89-4973-b31f-6bc6b7af84e7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:02.493743 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-0f8dac76-1e89-4973-b31f-6bc6b7af84e7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.351024 Jul 14 17:54:02.494310 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 183/295] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:02 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:02.518444 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-d1b155b4-6f20-4d03-b4ab-216aac1498d0 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:02.519048 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-d1b155b4-6f20-4d03-b4ab-216aac1498d0 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:02.525571 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d1b155b4-6f20-4d03-b4ab-216aac1498d0 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:02.526005 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d1b155b4-6f20-4d03-b4ab-216aac1498d0 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:02.526759 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d1b155b4-6f20-4d03-b4ab-216aac1498d0 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:02.527190 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d1b155b4-6f20-4d03-b4ab-216aac1498d0 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:02.658650 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-d1b155b4-6f20-4d03-b4ab-216aac1498d0 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:02.667316 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-d1b155b4-6f20-4d03-b4ab-216aac1498d0 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1554 microversion: 2.1 time: 0.152658 Jul 14 17:54:02.667981 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 113/296] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:02 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:03.510329 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-5ad1597c-81c3-47fe-a482-b8959b8419db tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:03.510964 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-5ad1597c-81c3-47fe-a482-b8959b8419db tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:03.512918 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:54:03.518995 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5ad1597c-81c3-47fe-a482-b8959b8419db tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:03.519437 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5ad1597c-81c3-47fe-a482-b8959b8419db tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:03.520224 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5ad1597c-81c3-47fe-a482-b8959b8419db tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:03.520655 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5ad1597c-81c3-47fe-a482-b8959b8419db tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:03.655382 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-5ad1597c-81c3-47fe-a482-b8959b8419db tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:03.662767 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-5ad1597c-81c3-47fe-a482-b8959b8419db tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.156140 Jul 14 17:54:03.663332 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 184/297] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:03 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:03.685791 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-2b79bf35-2938-407b-8a52-004493810146 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:03.686400 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-2b79bf35-2938-407b-8a52-004493810146 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:03.693748 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2b79bf35-2938-407b-8a52-004493810146 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:03.694197 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2b79bf35-2938-407b-8a52-004493810146 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:03.694974 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2b79bf35-2938-407b-8a52-004493810146 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:03.695418 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2b79bf35-2938-407b-8a52-004493810146 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:03.824556 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-2b79bf35-2938-407b-8a52-004493810146 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:03.833189 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-2b79bf35-2938-407b-8a52-004493810146 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1554 microversion: 2.1 time: 0.151155 Jul 14 17:54:03.833773 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 114/298] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:03 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:04.679046 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-3458f286-b59f-4b40-be23-42718176e99c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:04.679723 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-3458f286-b59f-4b40-be23-42718176e99c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:04.685744 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3458f286-b59f-4b40-be23-42718176e99c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:04.686197 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3458f286-b59f-4b40-be23-42718176e99c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:04.686962 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3458f286-b59f-4b40-be23-42718176e99c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:04.687399 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3458f286-b59f-4b40-be23-42718176e99c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:04.818028 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-3458f286-b59f-4b40-be23-42718176e99c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:04.825709 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-3458f286-b59f-4b40-be23-42718176e99c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.150479 Jul 14 17:54:04.826357 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 185/299] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:04 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:04.852423 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-3487e8e4-4b3c-4d51-a5b3-16f5873f334a tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:04.853063 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-3487e8e4-4b3c-4d51-a5b3-16f5873f334a tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:04.859548 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3487e8e4-4b3c-4d51-a5b3-16f5873f334a tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:04.860040 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3487e8e4-4b3c-4d51-a5b3-16f5873f334a tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:04.860821 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3487e8e4-4b3c-4d51-a5b3-16f5873f334a tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:04.861259 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3487e8e4-4b3c-4d51-a5b3-16f5873f334a tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:04.992138 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-3487e8e4-4b3c-4d51-a5b3-16f5873f334a tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:05.000138 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-3487e8e4-4b3c-4d51-a5b3-16f5873f334a tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1554 microversion: 2.1 time: 0.151527 Jul 14 17:54:05.000704 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 115/300] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:04 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:05.844938 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-f020fbad-1f91-4e52-862a-63256dc63334 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:05.846067 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-f020fbad-1f91-4e52-862a-63256dc63334 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:05.852073 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f020fbad-1f91-4e52-862a-63256dc63334 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:05.852519 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f020fbad-1f91-4e52-862a-63256dc63334 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:05.853287 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f020fbad-1f91-4e52-862a-63256dc63334 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:05.853718 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f020fbad-1f91-4e52-862a-63256dc63334 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:06.016775 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-088bfd66-e8aa-48ab-b234-448bc2838cd6 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:06.017389 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-088bfd66-e8aa-48ab-b234-448bc2838cd6 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:06.024079 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-088bfd66-e8aa-48ab-b234-448bc2838cd6 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:06.024537 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-088bfd66-e8aa-48ab-b234-448bc2838cd6 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:06.025311 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-088bfd66-e8aa-48ab-b234-448bc2838cd6 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:06.025757 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-088bfd66-e8aa-48ab-b234-448bc2838cd6 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:06.164834 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-f020fbad-1f91-4e52-862a-63256dc63334 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:06.172371 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-f020fbad-1f91-4e52-862a-63256dc63334 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.331425 Jul 14 17:54:06.173473 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 186/301] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:05 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:06.194384 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-088bfd66-e8aa-48ab-b234-448bc2838cd6 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:06.202614 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-088bfd66-e8aa-48ab-b234-448bc2838cd6 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1554 microversion: 2.1 time: 0.189660 Jul 14 17:54:06.203176 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 116/302] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:06 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1554 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:54:07.189795 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-9a3a5c03-3e9a-4039-90ed-f87d6a2c0896 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:07.190433 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-9a3a5c03-3e9a-4039-90ed-f87d6a2c0896 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:07.197740 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9a3a5c03-3e9a-4039-90ed-f87d6a2c0896 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:07.198190 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9a3a5c03-3e9a-4039-90ed-f87d6a2c0896 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:07.198957 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9a3a5c03-3e9a-4039-90ed-f87d6a2c0896 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:07.199397 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9a3a5c03-3e9a-4039-90ed-f87d6a2c0896 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:07.218368 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-1ee82211-21f0-4b15-bdc8-b2a162f4f21d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:07.218975 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-1ee82211-21f0-4b15-bdc8-b2a162f4f21d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:07.225573 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1ee82211-21f0-4b15-bdc8-b2a162f4f21d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:07.226020 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1ee82211-21f0-4b15-bdc8-b2a162f4f21d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:07.226792 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1ee82211-21f0-4b15-bdc8-b2a162f4f21d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:07.227230 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1ee82211-21f0-4b15-bdc8-b2a162f4f21d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:07.398832 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-9a3a5c03-3e9a-4039-90ed-f87d6a2c0896 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:07.402830 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-1ee82211-21f0-4b15-bdc8-b2a162f4f21d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:07.406827 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-9a3a5c03-3e9a-4039-90ed-f87d6a2c0896 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.221035 Jul 14 17:54:07.407436 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 187/303] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:07 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:07.411396 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-1ee82211-21f0-4b15-bdc8-b2a162f4f21d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1554 microversion: 2.1 time: 0.196752 Jul 14 17:54:07.412268 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 117/304] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:07 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1554 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:54:08.424145 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-a7bbc0b0-d233-49e4-95db-d32fd15be51f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:08.424771 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-a7bbc0b0-d233-49e4-95db-d32fd15be51f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:08.428782 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-5b44f060-5c78-494a-9633-d2dbd57f6a26 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:08.429384 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-5b44f060-5c78-494a-9633-d2dbd57f6a26 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:08.430715 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a7bbc0b0-d233-49e4-95db-d32fd15be51f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:08.431176 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a7bbc0b0-d233-49e4-95db-d32fd15be51f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:08.432678 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a7bbc0b0-d233-49e4-95db-d32fd15be51f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:08.432678 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a7bbc0b0-d233-49e4-95db-d32fd15be51f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:08.436164 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5b44f060-5c78-494a-9633-d2dbd57f6a26 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:08.437864 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5b44f060-5c78-494a-9633-d2dbd57f6a26 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:08.437864 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5b44f060-5c78-494a-9633-d2dbd57f6a26 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:08.437864 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5b44f060-5c78-494a-9633-d2dbd57f6a26 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:08.638669 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-a7bbc0b0-d233-49e4-95db-d32fd15be51f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:08.643785 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-5b44f060-5c78-494a-9633-d2dbd57f6a26 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:08.652762 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-5b44f060-5c78-494a-9633-d2dbd57f6a26 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1554 microversion: 2.1 time: 0.228199 Jul 14 17:54:08.652958 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-a7bbc0b0-d233-49e4-95db-d32fd15be51f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.232573 Jul 14 17:54:08.653458 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 118/305] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:08 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1554 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:54:08.659694 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 188/306] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:08 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:09.669613 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-1d701370-0ca6-4a03-ae34-8b92bae2f575 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:09.670167 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-1d701370-0ca6-4a03-ae34-8b92bae2f575 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:09.678807 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-2d2df5e0-ec5c-4651-a47a-74ff96abe270 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:09.679434 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-2d2df5e0-ec5c-4651-a47a-74ff96abe270 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:09.695577 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1d701370-0ca6-4a03-ae34-8b92bae2f575 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:09.696326 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1d701370-0ca6-4a03-ae34-8b92bae2f575 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:09.697178 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1d701370-0ca6-4a03-ae34-8b92bae2f575 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:09.697602 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1d701370-0ca6-4a03-ae34-8b92bae2f575 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:09.701787 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2d2df5e0-ec5c-4651-a47a-74ff96abe270 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:09.702245 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2d2df5e0-ec5c-4651-a47a-74ff96abe270 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:09.703037 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2d2df5e0-ec5c-4651-a47a-74ff96abe270 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:09.703476 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2d2df5e0-ec5c-4651-a47a-74ff96abe270 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:09.910255 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-1d701370-0ca6-4a03-ae34-8b92bae2f575 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:09.917617 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-2d2df5e0-ec5c-4651-a47a-74ff96abe270 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:09.918665 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-1d701370-0ca6-4a03-ae34-8b92bae2f575 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.253052 Jul 14 17:54:09.926418 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-2d2df5e0-ec5c-4651-a47a-74ff96abe270 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1554 microversion: 2.1 time: 0.251230 Jul 14 17:54:09.926913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 189/307] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:09 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1554 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:09.928815 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 119/308] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:09 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:10.377140 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [req-bfff0090-adc1-4485-9649-fcff2b28df21 req-11e17de2-b212-4e89-87e7-99505fe0d58a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "694a2002-80ed-4200-ad1e-83f4471de34b", "name": "network-vif-deleted", "tag": "35a6a884-f267-4330-b918-3243a1a07498"}]} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:54:10.390460 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-bfff0090-adc1-4485-9649-fcff2b28df21 req-11e17de2-b212-4e89-87e7-99505fe0d58a service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:10.391202 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-bfff0090-adc1-4485-9649-fcff2b28df21 req-11e17de2-b212-4e89-87e7-99505fe0d58a service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:10.405644 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.compute.server_external_events [req-bfff0090-adc1-4485-9649-fcff2b28df21 req-11e17de2-b212-4e89-87e7-99505fe0d58a service nova] Creating event network-vif-deleted:35a6a884-f267-4330-b918-3243a1a07498 for instance 694a2002-80ed-4200-ad1e-83f4471de34b on hv-cinder-84989 Jul 14 17:54:10.412164 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [req-bfff0090-adc1-4485-9649-fcff2b28df21 req-11e17de2-b212-4e89-87e7-99505fe0d58a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039910 Jul 14 17:54:10.413280 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 190/309] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 17:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:54:10.935313 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-b53c1991-c326-4aff-b114-1bb63459a607 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:10.935946 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-b53c1991-c326-4aff-b114-1bb63459a607 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:10.945108 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-17311bbf-7ab5-4531-87a9-9b926e5d9f1d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:10.947538 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-17311bbf-7ab5-4531-87a9-9b926e5d9f1d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:10.948116 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b53c1991-c326-4aff-b114-1bb63459a607 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:10.948758 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b53c1991-c326-4aff-b114-1bb63459a607 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:10.950506 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b53c1991-c326-4aff-b114-1bb63459a607 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:10.950949 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b53c1991-c326-4aff-b114-1bb63459a607 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:10.958615 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-17311bbf-7ab5-4531-87a9-9b926e5d9f1d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:10.959789 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-17311bbf-7ab5-4531-87a9-9b926e5d9f1d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:10.960965 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-17311bbf-7ab5-4531-87a9-9b926e5d9f1d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:10.963429 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-17311bbf-7ab5-4531-87a9-9b926e5d9f1d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:11.009157 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-17311bbf-7ab5-4531-87a9-9b926e5d9f1d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:11.010015 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-17311bbf-7ab5-4531-87a9-9b926e5d9f1d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:11.010552 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.objects.instance [None req-17311bbf-7ab5-4531-87a9-9b926e5d9f1d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lazy-loading 'fault' on Instance uuid 694a2002-80ed-4200-ad1e-83f4471de34b {{(pid=129471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 17:54:11.119310 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-17311bbf-7ab5-4531-87a9-9b926e5d9f1d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1201ac0aa7484f96e271410342a6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ba80b0874640d289c54ad4ac5a1018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:11.131242 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-17311bbf-7ab5-4531-87a9-9b926e5d9f1d tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 200 len: 1351 microversion: 2.1 time: 0.190595 Jul 14 17:54:11.132285 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 191/310] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:10 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 1351 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:11.218464 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-b53c1991-c326-4aff-b114-1bb63459a607 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:11.227209 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-b53c1991-c326-4aff-b114-1bb63459a607 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.295602 Jul 14 17:54:11.232733 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 120/311] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:10 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:12.148908 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-9d4ca026-6511-4d30-b879-d9772cd03b96 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:12.149552 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-9d4ca026-6511-4d30-b879-d9772cd03b96 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:12.155512 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9d4ca026-6511-4d30-b879-d9772cd03b96 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:12.155978 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9d4ca026-6511-4d30-b879-d9772cd03b96 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:12.156742 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9d4ca026-6511-4d30-b879-d9772cd03b96 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:12.157171 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9d4ca026-6511-4d30-b879-d9772cd03b96 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:12.173927 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.wsgi [None req-9d4ca026-6511-4d30-b879-d9772cd03b96 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] HTTP exception thrown: Instance 694a2002-80ed-4200-ad1e-83f4471de34b could not be found. Jul 14 17:54:12.179297 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-9d4ca026-6511-4d30-b879-d9772cd03b96 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Request method failure captured: Jul 14 17:54:12.179297 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: request: GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b HTTP/1.1 Jul 14 17:54:12.179297 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept: application/json Jul 14 17:54:12.179297 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept-Encoding: identity Jul 14 17:54:12.179297 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Connection: close Jul 14 17:54:12.179297 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Length: 0 Jul 14 17:54:12.179297 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Type: application/json Jul 14 17:54:12.179297 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Host: 10.222.0.64 Jul 14 17:54:12.179297 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Openstack-System-Scope: None Jul 14 17:54:12.179297 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: User-Agent: python-urllib3/1.26.9 Jul 14 17:54:12.179297 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Auth-Token: gAAAAABi0Fe-JbyEMttmAmV_OA9BdGHnISSC28LWCI_seajXYJINT94QzWAD-7IW5xMWHY72J5YGvKF9hCfCtIfzec2NMhlSn6YNeAw7LdEzumwi3bSmPjyIDejGFuYmbMJZSccSQd70qZ33Souh8QJlILyHH5Z23blubd6Yvs5LZK73O2gOxdk Jul 14 17:54:12.179297 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Id: None Jul 14 17:54:12.179297 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Name: None Jul 14 17:54:12.179297 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Identity-Status: Confirmed Jul 14 17:54:12.179297 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Is-Admin-Project: True Jul 14 17:54:12.179297 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Id: default Jul 14 17:54:12.179297 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Name: Default Jul 14 17:54:12.179297 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Id: 65ba80b0874640d289c54ad4ac5a1018 Jul 14 17:54:12.179297 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Name: tempest-DeleteServersTestJSON-1205357218 Jul 14 17:54:12.179297 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Role: reader,member Jul 14 17:54:12.179297 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Roles: reader,member Jul 14 17:54:12.180653 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/65ba80b0874640d289c54ad4ac5a1018"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/65ba80b0874640d289c54ad4ac5a1018"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/65ba80b0874640d289c54ad4ac5a1018"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_65ba80b0874640d289c54ad4ac5a1018", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 17:54:12.180653 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant: tempest-DeleteServersTestJSON-1205357218 Jul 14 17:54:12.180653 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Id: 65ba80b0874640d289c54ad4ac5a1018 Jul 14 17:54:12.180653 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Name: tempest-DeleteServersTestJSON-1205357218 Jul 14 17:54:12.180653 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User: tempest-DeleteServersTestJSON-1205357218-project Jul 14 17:54:12.180653 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Id: default Jul 14 17:54:12.180653 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Name: Default Jul 14 17:54:12.180653 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Id: be1201ac0aa7484f96e271410342a6b9 Jul 14 17:54:12.180653 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Name: tempest-DeleteServersTestJSON-1205357218-project Jul 14 17:54:12.180653 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: method: > Jul 14 17:54:12.180653 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: exception: Instance 694a2002-80ed-4200-ad1e-83f4471de34b could not be found. Jul 14 17:54:12.180653 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: action_args: {'id': '694a2002-80ed-4200-ad1e-83f4471de34b'} Jul 14 17:54:12.181355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 17:54:12.181355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:54:12.181355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 17:54:12.181355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 17:54:12.181355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 17:54:12.181355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 17:54:12.181355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 17:54:12.181355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 17:54:12.181355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 17:54:12.181355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 17:54:12.181355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 694a2002-80ed-4200-ad1e-83f4471de34b could not be found. Jul 14 17:54:12.181355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:54:12.181355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:54:12.181355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:54:12.181355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:54:12.181355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:54:12.181355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:54:12.181355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 17:54:12.181355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 17:54:12.181355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 17:54:12.182511 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 17:54:12.182511 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 17:54:12.182511 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 17:54:12.182511 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 17:54:12.182511 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 17:54:12.182511 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 17:54:12.182511 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 17:54:12.182511 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 694a2002-80ed-4200-ad1e-83f4471de34b could not be found. Jul 14 17:54:12.182511 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:54:12.182511 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:54:12.182511 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:54:12.182511 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:54:12.182511 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:54:12.182511 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:54:12.182511 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 17:54:12.182511 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 17:54:12.182511 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 694a2002-80ed-4200-ad1e-83f4471de34b could not be found. Jul 14 17:54:12.182511 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:54:12.184366 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-9d4ca026-6511-4d30-b879-d9772cd03b96 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Returning 404 to user: Instance 694a2002-80ed-4200-ad1e-83f4471de34b could not be found. {{(pid=129471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 17:54:12.184366 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-9d4ca026-6511-4d30-b879-d9772cd03b96 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 404 len: 111 microversion: 2.1 time: 0.035842 Jul 14 17:54:12.184366 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 192/312] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:12 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 17:54:12.244527 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-6230d6c3-bd6a-4e37-aa61-5fc41ecffbb7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:12.245141 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-6230d6c3-bd6a-4e37-aa61-5fc41ecffbb7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:12.252750 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6230d6c3-bd6a-4e37-aa61-5fc41ecffbb7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:12.253212 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6230d6c3-bd6a-4e37-aa61-5fc41ecffbb7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:12.253995 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6230d6c3-bd6a-4e37-aa61-5fc41ecffbb7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:12.254431 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6230d6c3-bd6a-4e37-aa61-5fc41ecffbb7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:12.309840 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-d696b6cc-cf17-42a0-bc34-0ca10a881dcc tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:12.310793 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-d696b6cc-cf17-42a0-bc34-0ca10a881dcc tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:12.320405 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d696b6cc-cf17-42a0-bc34-0ca10a881dcc tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:12.321129 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d696b6cc-cf17-42a0-bc34-0ca10a881dcc tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:12.322314 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d696b6cc-cf17-42a0-bc34-0ca10a881dcc tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:12.322758 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d696b6cc-cf17-42a0-bc34-0ca10a881dcc tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:12.336899 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.wsgi [None req-d696b6cc-cf17-42a0-bc34-0ca10a881dcc tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] HTTP exception thrown: Instance 694a2002-80ed-4200-ad1e-83f4471de34b could not be found. Jul 14 17:54:12.339003 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-d696b6cc-cf17-42a0-bc34-0ca10a881dcc tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Request method failure captured: Jul 14 17:54:12.339003 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: request: GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b/os-volume_attachments HTTP/1.1 Jul 14 17:54:12.339003 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept: application/json Jul 14 17:54:12.339003 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept-Encoding: identity Jul 14 17:54:12.339003 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Connection: close Jul 14 17:54:12.339003 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Length: 0 Jul 14 17:54:12.339003 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Type: application/json Jul 14 17:54:12.339003 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Host: 10.222.0.64 Jul 14 17:54:12.339003 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Openstack-System-Scope: None Jul 14 17:54:12.339003 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: User-Agent: python-urllib3/1.26.9 Jul 14 17:54:12.339003 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Auth-Token: gAAAAABi0Fe-JbyEMttmAmV_OA9BdGHnISSC28LWCI_seajXYJINT94QzWAD-7IW5xMWHY72J5YGvKF9hCfCtIfzec2NMhlSn6YNeAw7LdEzumwi3bSmPjyIDejGFuYmbMJZSccSQd70qZ33Souh8QJlILyHH5Z23blubd6Yvs5LZK73O2gOxdk Jul 14 17:54:12.339003 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Id: None Jul 14 17:54:12.339003 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Name: None Jul 14 17:54:12.339003 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Identity-Status: Confirmed Jul 14 17:54:12.339003 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Is-Admin-Project: True Jul 14 17:54:12.339003 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Id: default Jul 14 17:54:12.339003 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Name: Default Jul 14 17:54:12.339003 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Id: 65ba80b0874640d289c54ad4ac5a1018 Jul 14 17:54:12.339003 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Name: tempest-DeleteServersTestJSON-1205357218 Jul 14 17:54:12.339003 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Role: reader,member Jul 14 17:54:12.339003 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Roles: reader,member Jul 14 17:54:12.340272 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/65ba80b0874640d289c54ad4ac5a1018"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/65ba80b0874640d289c54ad4ac5a1018"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/65ba80b0874640d289c54ad4ac5a1018"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_65ba80b0874640d289c54ad4ac5a1018", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 17:54:12.340272 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant: tempest-DeleteServersTestJSON-1205357218 Jul 14 17:54:12.340272 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Id: 65ba80b0874640d289c54ad4ac5a1018 Jul 14 17:54:12.340272 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Name: tempest-DeleteServersTestJSON-1205357218 Jul 14 17:54:12.340272 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User: tempest-DeleteServersTestJSON-1205357218-project Jul 14 17:54:12.340272 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Id: default Jul 14 17:54:12.340272 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Name: Default Jul 14 17:54:12.340272 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Id: be1201ac0aa7484f96e271410342a6b9 Jul 14 17:54:12.340272 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Name: tempest-DeleteServersTestJSON-1205357218-project Jul 14 17:54:12.340272 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: method: > Jul 14 17:54:12.340272 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: exception: Instance 694a2002-80ed-4200-ad1e-83f4471de34b could not be found. Jul 14 17:54:12.340272 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: action_args: {'server_id': '694a2002-80ed-4200-ad1e-83f4471de34b'} Jul 14 17:54:12.340914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 17:54:12.340914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:54:12.340914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 17:54:12.340914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 17:54:12.340914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 17:54:12.340914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 17:54:12.340914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 17:54:12.340914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 17:54:12.340914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 17:54:12.340914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 17:54:12.340914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 694a2002-80ed-4200-ad1e-83f4471de34b could not be found. Jul 14 17:54:12.340914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:54:12.340914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:54:12.340914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:54:12.340914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:54:12.340914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:54:12.340914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:54:12.340914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 17:54:12.340914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 17:54:12.340914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 17:54:12.341967 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 17:54:12.341967 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 17:54:12.341967 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 17:54:12.341967 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 17:54:12.341967 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 17:54:12.341967 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 14 17:54:12.341967 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 14 17:54:12.341967 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 17:54:12.341967 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 17:54:12.341967 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 694a2002-80ed-4200-ad1e-83f4471de34b could not be found. Jul 14 17:54:12.341967 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:54:12.341967 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:54:12.341967 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:54:12.341967 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:54:12.341967 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:54:12.341967 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:54:12.341967 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 17:54:12.341967 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 17:54:12.341967 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 694a2002-80ed-4200-ad1e-83f4471de34b could not be found. Jul 14 17:54:12.341967 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:54:12.343755 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-d696b6cc-cf17-42a0-bc34-0ca10a881dcc tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Returning 404 to user: Instance 694a2002-80ed-4200-ad1e-83f4471de34b could not be found. {{(pid=129471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 17:54:12.343755 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-d696b6cc-cf17-42a0-bc34-0ca10a881dcc tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034847 Jul 14 17:54:12.343755 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 193/313] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Jul 14 17:54:12 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 17:54:12.411399 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-6230d6c3-bd6a-4e37-aa61-5fc41ecffbb7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:12.419838 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-6230d6c3-bd6a-4e37-aa61-5fc41ecffbb7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.179064 Jul 14 17:54:12.420371 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 121/314] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:12 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:13.438741 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-0c39947c-1106-4d9e-b93f-c2aebf5b844f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:13.439544 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-0c39947c-1106-4d9e-b93f-c2aebf5b844f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:13.449766 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0c39947c-1106-4d9e-b93f-c2aebf5b844f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:13.450309 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0c39947c-1106-4d9e-b93f-c2aebf5b844f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:13.451238 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0c39947c-1106-4d9e-b93f-c2aebf5b844f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:13.451692 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0c39947c-1106-4d9e-b93f-c2aebf5b844f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:13.596324 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-0c39947c-1106-4d9e-b93f-c2aebf5b844f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:13.596845 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-0d470283-07ce-46fb-a070-f5bf427b2a10 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:13.597356 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-0d470283-07ce-46fb-a070-f5bf427b2a10 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:13.605429 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0d470283-07ce-46fb-a070-f5bf427b2a10 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:13.605983 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0d470283-07ce-46fb-a070-f5bf427b2a10 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:13.606975 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0d470283-07ce-46fb-a070-f5bf427b2a10 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:13.607249 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-0c39947c-1106-4d9e-b93f-c2aebf5b844f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.172530 Jul 14 17:54:13.607522 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0d470283-07ce-46fb-a070-f5bf427b2a10 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:13.607839 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 194/315] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:13 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:13.622690 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.wsgi [None req-0d470283-07ce-46fb-a070-f5bf427b2a10 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] HTTP exception thrown: Instance 694a2002-80ed-4200-ad1e-83f4471de34b could not be found. Jul 14 17:54:13.627518 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-0d470283-07ce-46fb-a070-f5bf427b2a10 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Request method failure captured: Jul 14 17:54:13.627518 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: request: DELETE /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b HTTP/1.1 Jul 14 17:54:13.627518 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept: application/json Jul 14 17:54:13.627518 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept-Encoding: identity Jul 14 17:54:13.627518 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Connection: close Jul 14 17:54:13.627518 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Length: 0 Jul 14 17:54:13.627518 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Type: application/json Jul 14 17:54:13.627518 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Host: 10.222.0.64 Jul 14 17:54:13.627518 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Openstack-System-Scope: None Jul 14 17:54:13.627518 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: User-Agent: python-urllib3/1.26.9 Jul 14 17:54:13.627518 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Auth-Token: gAAAAABi0Fe-JbyEMttmAmV_OA9BdGHnISSC28LWCI_seajXYJINT94QzWAD-7IW5xMWHY72J5YGvKF9hCfCtIfzec2NMhlSn6YNeAw7LdEzumwi3bSmPjyIDejGFuYmbMJZSccSQd70qZ33Souh8QJlILyHH5Z23blubd6Yvs5LZK73O2gOxdk Jul 14 17:54:13.627518 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Id: None Jul 14 17:54:13.627518 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Name: None Jul 14 17:54:13.627518 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Identity-Status: Confirmed Jul 14 17:54:13.627518 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Is-Admin-Project: True Jul 14 17:54:13.627518 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Id: default Jul 14 17:54:13.627518 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Name: Default Jul 14 17:54:13.627518 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Id: 65ba80b0874640d289c54ad4ac5a1018 Jul 14 17:54:13.627518 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Name: tempest-DeleteServersTestJSON-1205357218 Jul 14 17:54:13.627518 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Role: reader,member Jul 14 17:54:13.627518 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Roles: reader,member Jul 14 17:54:13.628777 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/65ba80b0874640d289c54ad4ac5a1018"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/65ba80b0874640d289c54ad4ac5a1018"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/65ba80b0874640d289c54ad4ac5a1018"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_65ba80b0874640d289c54ad4ac5a1018", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 17:54:13.628777 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant: tempest-DeleteServersTestJSON-1205357218 Jul 14 17:54:13.628777 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Id: 65ba80b0874640d289c54ad4ac5a1018 Jul 14 17:54:13.628777 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Name: tempest-DeleteServersTestJSON-1205357218 Jul 14 17:54:13.628777 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User: tempest-DeleteServersTestJSON-1205357218-project Jul 14 17:54:13.628777 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Id: default Jul 14 17:54:13.628777 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Name: Default Jul 14 17:54:13.628777 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Id: be1201ac0aa7484f96e271410342a6b9 Jul 14 17:54:13.628777 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Name: tempest-DeleteServersTestJSON-1205357218-project Jul 14 17:54:13.628777 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: method: > Jul 14 17:54:13.628777 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: exception: Instance 694a2002-80ed-4200-ad1e-83f4471de34b could not be found. Jul 14 17:54:13.628777 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: action_args: {'id': '694a2002-80ed-4200-ad1e-83f4471de34b'} Jul 14 17:54:13.629591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 17:54:13.629591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:54:13.629591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 17:54:13.629591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 17:54:13.629591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 17:54:13.629591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 17:54:13.629591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 17:54:13.629591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 17:54:13.629591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 17:54:13.629591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 17:54:13.629591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 694a2002-80ed-4200-ad1e-83f4471de34b could not be found. Jul 14 17:54:13.629591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 17:54:13.629591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:54:13.629591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 17:54:13.629591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:54:13.629591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:54:13.629591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:54:13.629591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 17:54:13.629591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 17:54:13.629591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 17:54:13.630665 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 17:54:13.630665 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 17:54:13.630665 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 17:54:13.630665 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 17:54:13.630665 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 17:54:13.630665 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 17:54:13.630665 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 17:54:13.630665 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 17:54:13.630665 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 17:54:13.630665 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 694a2002-80ed-4200-ad1e-83f4471de34b could not be found. Jul 14 17:54:13.630665 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 17:54:13.630665 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:54:13.630665 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 17:54:13.630665 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:54:13.630665 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:54:13.630665 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:54:13.630665 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 17:54:13.630665 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 17:54:13.630665 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 694a2002-80ed-4200-ad1e-83f4471de34b could not be found. Jul 14 17:54:13.630665 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 17:54:13.631781 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-0d470283-07ce-46fb-a070-f5bf427b2a10 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Returning 404 to user: Instance 694a2002-80ed-4200-ad1e-83f4471de34b could not be found. {{(pid=129470) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 17:54:13.631781 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-0d470283-07ce-46fb-a070-f5bf427b2a10 tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "DELETE /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 404 len: 111 microversion: 2.1 time: 0.038041 Jul 14 17:54:13.631781 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 122/316] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Jul 14 17:54:13 2022] DELETE /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 17:54:13.638101 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-903f9597-1ae9-41d0-a4b6-75a358759e7c tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:13.638713 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-903f9597-1ae9-41d0-a4b6-75a358759e7c tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] [instance: 694a2002-80ed-4200-ad1e-83f4471de34b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:13.645629 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-903f9597-1ae9-41d0-a4b6-75a358759e7c tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:13.646083 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-903f9597-1ae9-41d0-a4b6-75a358759e7c tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:13.646887 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-903f9597-1ae9-41d0-a4b6-75a358759e7c tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:13.647350 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-903f9597-1ae9-41d0-a4b6-75a358759e7c tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:13.661738 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.wsgi [None req-903f9597-1ae9-41d0-a4b6-75a358759e7c tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] HTTP exception thrown: Instance 694a2002-80ed-4200-ad1e-83f4471de34b could not be found. Jul 14 17:54:13.663515 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-903f9597-1ae9-41d0-a4b6-75a358759e7c tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Request method failure captured: Jul 14 17:54:13.663515 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: request: GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b HTTP/1.1 Jul 14 17:54:13.663515 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept: application/json Jul 14 17:54:13.663515 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept-Encoding: identity Jul 14 17:54:13.663515 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Connection: close Jul 14 17:54:13.663515 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Length: 0 Jul 14 17:54:13.663515 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Type: application/json Jul 14 17:54:13.663515 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Host: 10.222.0.64 Jul 14 17:54:13.663515 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Openstack-System-Scope: None Jul 14 17:54:13.663515 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: User-Agent: python-urllib3/1.26.9 Jul 14 17:54:13.663515 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Auth-Token: gAAAAABi0Fe-JbyEMttmAmV_OA9BdGHnISSC28LWCI_seajXYJINT94QzWAD-7IW5xMWHY72J5YGvKF9hCfCtIfzec2NMhlSn6YNeAw7LdEzumwi3bSmPjyIDejGFuYmbMJZSccSQd70qZ33Souh8QJlILyHH5Z23blubd6Yvs5LZK73O2gOxdk Jul 14 17:54:13.663515 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Id: None Jul 14 17:54:13.663515 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Name: None Jul 14 17:54:13.663515 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Identity-Status: Confirmed Jul 14 17:54:13.663515 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Is-Admin-Project: True Jul 14 17:54:13.663515 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Id: default Jul 14 17:54:13.663515 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Name: Default Jul 14 17:54:13.663515 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Id: 65ba80b0874640d289c54ad4ac5a1018 Jul 14 17:54:13.663515 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Name: tempest-DeleteServersTestJSON-1205357218 Jul 14 17:54:13.663515 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Role: reader,member Jul 14 17:54:13.663515 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Roles: reader,member Jul 14 17:54:13.664975 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/65ba80b0874640d289c54ad4ac5a1018"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/65ba80b0874640d289c54ad4ac5a1018"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/65ba80b0874640d289c54ad4ac5a1018"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_65ba80b0874640d289c54ad4ac5a1018", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 17:54:13.664975 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant: tempest-DeleteServersTestJSON-1205357218 Jul 14 17:54:13.664975 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Id: 65ba80b0874640d289c54ad4ac5a1018 Jul 14 17:54:13.664975 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Name: tempest-DeleteServersTestJSON-1205357218 Jul 14 17:54:13.664975 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User: tempest-DeleteServersTestJSON-1205357218-project Jul 14 17:54:13.664975 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Id: default Jul 14 17:54:13.664975 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Name: Default Jul 14 17:54:13.664975 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Id: be1201ac0aa7484f96e271410342a6b9 Jul 14 17:54:13.664975 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Name: tempest-DeleteServersTestJSON-1205357218-project Jul 14 17:54:13.664975 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: method: > Jul 14 17:54:13.664975 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: exception: Instance 694a2002-80ed-4200-ad1e-83f4471de34b could not be found. Jul 14 17:54:13.664975 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: action_args: {'id': '694a2002-80ed-4200-ad1e-83f4471de34b'} Jul 14 17:54:13.665792 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 17:54:13.665792 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:54:13.665792 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 17:54:13.665792 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 17:54:13.665792 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 17:54:13.665792 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 17:54:13.665792 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 17:54:13.665792 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 17:54:13.665792 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 17:54:13.665792 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 17:54:13.665792 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 694a2002-80ed-4200-ad1e-83f4471de34b could not be found. Jul 14 17:54:13.665792 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:54:13.665792 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:54:13.665792 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:54:13.665792 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:54:13.665792 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:54:13.665792 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:54:13.665792 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 17:54:13.665792 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 17:54:13.665792 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 17:54:13.667022 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 17:54:13.667022 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 17:54:13.667022 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 17:54:13.667022 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 17:54:13.667022 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 17:54:13.667022 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 17:54:13.667022 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 17:54:13.667022 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 694a2002-80ed-4200-ad1e-83f4471de34b could not be found. Jul 14 17:54:13.667022 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:54:13.667022 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:54:13.667022 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:54:13.667022 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:54:13.667022 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:54:13.667022 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:54:13.667022 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 17:54:13.667022 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 17:54:13.667022 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 694a2002-80ed-4200-ad1e-83f4471de34b could not be found. Jul 14 17:54:13.667022 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:54:13.668352 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-903f9597-1ae9-41d0-a4b6-75a358759e7c tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] Returning 404 to user: Instance 694a2002-80ed-4200-ad1e-83f4471de34b could not be found. {{(pid=129471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 17:54:13.668352 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-903f9597-1ae9-41d0-a4b6-75a358759e7c tempest-DeleteServersTestJSON-1205357218 tempest-DeleteServersTestJSON-1205357218-project] 10.222.0.64 "GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b" status: 404 len: 111 microversion: 2.1 time: 0.031749 Jul 14 17:54:13.668352 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 195/317] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:13 2022] GET /compute/v2.1/servers/694a2002-80ed-4200-ad1e-83f4471de34b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 17:54:14.625636 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-e9994cfe-6cfb-4145-83c4-2cb7287a9032 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:14.626266 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-e9994cfe-6cfb-4145-83c4-2cb7287a9032 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:14.634681 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e9994cfe-6cfb-4145-83c4-2cb7287a9032 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:14.635135 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e9994cfe-6cfb-4145-83c4-2cb7287a9032 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:14.636153 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e9994cfe-6cfb-4145-83c4-2cb7287a9032 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:14.636574 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e9994cfe-6cfb-4145-83c4-2cb7287a9032 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:14.897191 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-f0b6edd5-5f81-4e1e-bedb-b9ccbf8778a4 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-469383288", "imageRef": "cf1f5d8c-9e49-4272-8e19-8e3c587056e1", "flavorRef": "452", "networks": [{"uuid": "efaa634e-c527-4548-841a-e8d87f1670aa"}]}} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:54:14.955706 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.network.neutron [None req-f0b6edd5-5f81-4e1e-bedb-b9ccbf8778a4 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] validate_networks() for [('efaa634e-c527-4548-841a-e8d87f1670aa', None, None, None, None, None)] {{(pid=129471) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 17:54:15.371121 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-e9994cfe-6cfb-4145-83c4-2cb7287a9032 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:15.375608 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:54:15.381941 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-e9994cfe-6cfb-4145-83c4-2cb7287a9032 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.760108 Jul 14 17:54:15.382719 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 123/318] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:14 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:15.911325 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-f0b6edd5-5f81-4e1e-bedb-b9ccbf8778a4 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Flavor limits 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 17:54:15.911860 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-f0b6edd5-5f81-4e1e-bedb-b9ccbf8778a4 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Image limits 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 17:54:15.912405 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-f0b6edd5-5f81-4e1e-bedb-b9ccbf8778a4 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Flavor pref 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 17:54:15.912893 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-f0b6edd5-5f81-4e1e-bedb-b9ccbf8778a4 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Image pref 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 17:54:15.913372 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-f0b6edd5-5f81-4e1e-bedb-b9ccbf8778a4 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 17:54:15.925370 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f0b6edd5-5f81-4e1e-bedb-b9ccbf8778a4 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:15.926157 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f0b6edd5-5f81-4e1e-bedb-b9ccbf8778a4 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:15.927312 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f0b6edd5-5f81-4e1e-bedb-b9ccbf8778a4 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:15.928361 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f0b6edd5-5f81-4e1e-bedb-b9ccbf8778a4 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:15.948638 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.quota [None req-f0b6edd5-5f81-4e1e-bedb-b9ccbf8778a4 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Getting quotas for project a84353cfe41640e3b13d561b615e1142. Resources: {'ram', 'cores', 'instances'} {{(pid=129471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 17:54:15.953332 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.quota [None req-f0b6edd5-5f81-4e1e-bedb-b9ccbf8778a4 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Getting quotas for user d3b3a526943646dcba7bb1806601696b and project a84353cfe41640e3b13d561b615e1142. Resources: {'ram', 'cores', 'instances'} {{(pid=129471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 17:54:15.966217 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-f0b6edd5-5f81-4e1e-bedb-b9ccbf8778a4 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Going to run 1 instances... {{(pid=129471) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 17:54:15.968943 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-f0b6edd5-5f81-4e1e-bedb-b9ccbf8778a4 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: c69458a5-5cab-40fc-bf93-332204bebcd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf1f5d8c-9e49-4272-8e19-8e3c587056e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 17:54:16.024776 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-f0b6edd5-5f81-4e1e-bedb-b9ccbf8778a4 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.131493 Jul 14 17:54:16.025640 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 196/319] 10.222.0.64 () {60 vars in 1146 bytes} [Thu Jul 14 17:54:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1133 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 17:54:16.040204 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-7d601d92-bad7-4f9e-9501-3c919cb0ecca tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:16.040204 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-7d601d92-bad7-4f9e-9501-3c919cb0ecca tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: c69458a5-5cab-40fc-bf93-332204bebcd5] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:16.156052 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-7d601d92-bad7-4f9e-9501-3c919cb0ecca tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:16.165825 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-7d601d92-bad7-4f9e-9501-3c919cb0ecca tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5" status: 200 len: 1213 microversion: 2.1 time: 0.132118 Jul 14 17:54:16.167069 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 124/320] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:16 2022] GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5 => generated 1213 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:16.401277 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-e110a162-d9ce-4d58-b283-c8f261b733d6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:16.402425 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-e110a162-d9ce-4d58-b283-c8f261b733d6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:16.414070 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e110a162-d9ce-4d58-b283-c8f261b733d6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:16.414751 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e110a162-d9ce-4d58-b283-c8f261b733d6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:16.415750 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e110a162-d9ce-4d58-b283-c8f261b733d6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:16.416421 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e110a162-d9ce-4d58-b283-c8f261b733d6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:16.805560 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-e110a162-d9ce-4d58-b283-c8f261b733d6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:16.829971 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-e110a162-d9ce-4d58-b283-c8f261b733d6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.430975 Jul 14 17:54:16.840316 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 197/321] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:16 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:17.195177 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-002a8e74-a100-40ff-b22a-db73f0c4f9f7 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:17.195790 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-002a8e74-a100-40ff-b22a-db73f0c4f9f7 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: c69458a5-5cab-40fc-bf93-332204bebcd5] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:17.212829 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-002a8e74-a100-40ff-b22a-db73f0c4f9f7 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:17.213501 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-002a8e74-a100-40ff-b22a-db73f0c4f9f7 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:17.214733 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-002a8e74-a100-40ff-b22a-db73f0c4f9f7 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:17.215349 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-002a8e74-a100-40ff-b22a-db73f0c4f9f7 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:17.350084 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-002a8e74-a100-40ff-b22a-db73f0c4f9f7 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:17.361017 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-002a8e74-a100-40ff-b22a-db73f0c4f9f7 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5" status: 200 len: 1265 microversion: 2.1 time: 0.173795 Jul 14 17:54:17.362523 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 125/322] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:17 2022] GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:17.855343 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-b7d24c97-d29e-4165-b6e5-2669a967d5e4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:17.856042 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-b7d24c97-d29e-4165-b6e5-2669a967d5e4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:17.872043 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b7d24c97-d29e-4165-b6e5-2669a967d5e4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:17.873139 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b7d24c97-d29e-4165-b6e5-2669a967d5e4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:17.874232 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b7d24c97-d29e-4165-b6e5-2669a967d5e4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:17.874681 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b7d24c97-d29e-4165-b6e5-2669a967d5e4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:18.232354 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-b7d24c97-d29e-4165-b6e5-2669a967d5e4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:18.255455 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-b7d24c97-d29e-4165-b6e5-2669a967d5e4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.403316 Jul 14 17:54:18.259772 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 198/323] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:17 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:18.399513 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-97db0c2f-77f6-4b52-a226-fb22f4ed1273 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:18.400999 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-97db0c2f-77f6-4b52-a226-fb22f4ed1273 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: c69458a5-5cab-40fc-bf93-332204bebcd5] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:18.412534 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-97db0c2f-77f6-4b52-a226-fb22f4ed1273 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:18.413587 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-97db0c2f-77f6-4b52-a226-fb22f4ed1273 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:18.417054 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-97db0c2f-77f6-4b52-a226-fb22f4ed1273 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:18.418293 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-97db0c2f-77f6-4b52-a226-fb22f4ed1273 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:18.629980 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-97db0c2f-77f6-4b52-a226-fb22f4ed1273 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:18.653318 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-97db0c2f-77f6-4b52-a226-fb22f4ed1273 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5" status: 200 len: 1271 microversion: 2.1 time: 0.259444 Jul 14 17:54:18.660185 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 126/324] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:18 2022] GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5 => generated 1271 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:19.278821 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-bb339443-326f-4bb8-9020-6579cec29069 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:19.279334 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-bb339443-326f-4bb8-9020-6579cec29069 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:19.292858 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bb339443-326f-4bb8-9020-6579cec29069 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:19.293787 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bb339443-326f-4bb8-9020-6579cec29069 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:19.300869 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bb339443-326f-4bb8-9020-6579cec29069 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:19.301440 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bb339443-326f-4bb8-9020-6579cec29069 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:19.341551 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:54:19.672991 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-d51a929a-8f4a-440c-ab7e-b7beba518e22 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:19.674458 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-d51a929a-8f4a-440c-ab7e-b7beba518e22 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: c69458a5-5cab-40fc-bf93-332204bebcd5] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:19.688445 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-bb339443-326f-4bb8-9020-6579cec29069 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:19.699230 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-bb339443-326f-4bb8-9020-6579cec29069 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.425469 Jul 14 17:54:19.705287 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d51a929a-8f4a-440c-ab7e-b7beba518e22 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:19.705716 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 199/325] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:19 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:19.708599 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d51a929a-8f4a-440c-ab7e-b7beba518e22 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:19.710863 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d51a929a-8f4a-440c-ab7e-b7beba518e22 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:19.712461 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d51a929a-8f4a-440c-ab7e-b7beba518e22 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:20.124087 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-d51a929a-8f4a-440c-ab7e-b7beba518e22 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:20.133820 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-d51a929a-8f4a-440c-ab7e-b7beba518e22 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5" status: 200 len: 1313 microversion: 2.1 time: 0.464574 Jul 14 17:54:20.134653 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 127/326] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:19 2022] GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5 => generated 1313 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:20.717287 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-3c97662e-4dd4-4a1f-8bae-60e168cc150f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:20.718278 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-3c97662e-4dd4-4a1f-8bae-60e168cc150f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:20.727534 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3c97662e-4dd4-4a1f-8bae-60e168cc150f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:20.728108 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3c97662e-4dd4-4a1f-8bae-60e168cc150f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:20.729220 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3c97662e-4dd4-4a1f-8bae-60e168cc150f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:20.729662 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3c97662e-4dd4-4a1f-8bae-60e168cc150f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:20.919984 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-3fb27cd5-805d-4da7-bee0-f2f834d8e52f req-3ba5f522-1034-47a3-8366-40340d5bf5e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c69458a5-5cab-40fc-bf93-332204bebcd5", "tag": "79249223-593f-4a5b-8226-3f41d2e34e6a"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:54:20.938763 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-3fb27cd5-805d-4da7-bee0-f2f834d8e52f req-3ba5f522-1034-47a3-8366-40340d5bf5e6 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:20.939474 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-3fb27cd5-805d-4da7-bee0-f2f834d8e52f req-3ba5f522-1034-47a3-8366-40340d5bf5e6 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:20.959161 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-3fb27cd5-805d-4da7-bee0-f2f834d8e52f req-3ba5f522-1034-47a3-8366-40340d5bf5e6 service nova] Creating event network-changed:79249223-593f-4a5b-8226-3f41d2e34e6a for instance c69458a5-5cab-40fc-bf93-332204bebcd5 on hv-cinder-84989 Jul 14 17:54:20.965261 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-3fb27cd5-805d-4da7-bee0-f2f834d8e52f req-3ba5f522-1034-47a3-8366-40340d5bf5e6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057745 Jul 14 17:54:20.966396 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 128/327] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 17:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:54:20.999542 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-3c97662e-4dd4-4a1f-8bae-60e168cc150f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:21.007881 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-3c97662e-4dd4-4a1f-8bae-60e168cc150f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.294359 Jul 14 17:54:21.010677 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 200/328] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:20 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:54:21.162856 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-7888b6c9-e77f-4eac-ad99-9833117f7dee tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:21.164233 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-7888b6c9-e77f-4eac-ad99-9833117f7dee tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: c69458a5-5cab-40fc-bf93-332204bebcd5] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:21.179272 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7888b6c9-e77f-4eac-ad99-9833117f7dee tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:21.180092 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7888b6c9-e77f-4eac-ad99-9833117f7dee tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:21.181581 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7888b6c9-e77f-4eac-ad99-9833117f7dee tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:21.182330 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7888b6c9-e77f-4eac-ad99-9833117f7dee tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:21.414537 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-7888b6c9-e77f-4eac-ad99-9833117f7dee tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:21.428008 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-7888b6c9-e77f-4eac-ad99-9833117f7dee tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5" status: 200 len: 1313 microversion: 2.1 time: 0.272509 Jul 14 17:54:21.429936 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 129/329] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:21 2022] GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5 => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:22.029019 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-20f12a92-6457-4674-9c35-d536e2bbc340 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:22.029649 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-20f12a92-6457-4674-9c35-d536e2bbc340 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:22.036265 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-20f12a92-6457-4674-9c35-d536e2bbc340 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:22.036661 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-20f12a92-6457-4674-9c35-d536e2bbc340 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:22.037442 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-20f12a92-6457-4674-9c35-d536e2bbc340 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:22.037881 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-20f12a92-6457-4674-9c35-d536e2bbc340 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:22.202455 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-20f12a92-6457-4674-9c35-d536e2bbc340 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:22.210742 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-20f12a92-6457-4674-9c35-d536e2bbc340 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.186230 Jul 14 17:54:22.211336 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 201/330] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:22 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:54:22.263489 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-c4b04d0f-3030-4d9c-944d-2861f11c7ee0 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] Action: 'create', calling method: .version_select at 0x7f1380083dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1400681342"}} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:54:22.455193 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-71665fd3-1d1d-42d8-840a-b34ad92402f4 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:22.456875 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-71665fd3-1d1d-42d8-840a-b34ad92402f4 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: c69458a5-5cab-40fc-bf93-332204bebcd5] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:22.467653 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-71665fd3-1d1d-42d8-840a-b34ad92402f4 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:22.468478 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-71665fd3-1d1d-42d8-840a-b34ad92402f4 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:22.469810 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-71665fd3-1d1d-42d8-840a-b34ad92402f4 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:22.470585 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-71665fd3-1d1d-42d8-840a-b34ad92402f4 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:22.702400 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-c4b04d0f-3030-4d9c-944d-2861f11c7ee0 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.596561 Jul 14 17:54:22.703849 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-71665fd3-1d1d-42d8-840a-b34ad92402f4 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:22.704012 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 130/331] 10.222.0.64 () {60 vars in 1154 bytes} [Thu Jul 14 17:54:22 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 600 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 14 17:54:22.712605 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-71665fd3-1d1d-42d8-840a-b34ad92402f4 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5" status: 200 len: 1313 microversion: 2.1 time: 0.267986 Jul 14 17:54:22.713278 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 202/332] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:22 2022] GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5 => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:22.719575 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-e1527595-741c-4d3e-9967-2e875e6e6d70 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] Calling method '.version_select at 0x7f13801335e0>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:22.780358 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-e1527595-741c-4d3e-9967-2e875e6e6d70 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/e8626cdf-0caf-4bed-b961-6b1b49acacac" status: 200 len: 345 microversion: 2.1 time: 0.065207 Jul 14 17:54:22.781146 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 131/333] 10.222.0.64 () {58 vars in 1244 bytes} [Thu Jul 14 17:54:22 2022] GET /compute/v2.1/os-volumes/e8626cdf-0caf-4bed-b961-6b1b49acacac => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:54:23.228230 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-ff7b1559-94db-4b2c-af74-5078fe370376 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:23.228844 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-ff7b1559-94db-4b2c-af74-5078fe370376 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:23.235077 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ff7b1559-94db-4b2c-af74-5078fe370376 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:23.235529 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ff7b1559-94db-4b2c-af74-5078fe370376 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:23.236334 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ff7b1559-94db-4b2c-af74-5078fe370376 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:23.236772 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ff7b1559-94db-4b2c-af74-5078fe370376 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:23.369096 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-ff7b1559-94db-4b2c-af74-5078fe370376 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:23.376454 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-ff7b1559-94db-4b2c-af74-5078fe370376 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.152041 Jul 14 17:54:23.376952 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 203/334] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:23 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:23.743992 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-3352b1d6-2ca3-4854-8d44-f2da05671734 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:23.746545 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-3352b1d6-2ca3-4854-8d44-f2da05671734 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: c69458a5-5cab-40fc-bf93-332204bebcd5] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:23.755683 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3352b1d6-2ca3-4854-8d44-f2da05671734 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:23.756196 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3352b1d6-2ca3-4854-8d44-f2da05671734 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:23.757018 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3352b1d6-2ca3-4854-8d44-f2da05671734 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:23.757473 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3352b1d6-2ca3-4854-8d44-f2da05671734 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:23.795243 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-a90fab38-14ce-49e2-88e4-22dd70225985 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] Calling method '.version_select at 0x7f1381c97c10>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:23.879326 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-a90fab38-14ce-49e2-88e4-22dd70225985 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/e8626cdf-0caf-4bed-b961-6b1b49acacac" status: 200 len: 345 microversion: 2.1 time: 0.088628 Jul 14 17:54:23.879904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 204/335] 10.222.0.64 () {58 vars in 1244 bytes} [Thu Jul 14 17:54:23 2022] GET /compute/v2.1/os-volumes/e8626cdf-0caf-4bed-b961-6b1b49acacac => generated 345 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:54:23.938637 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-3352b1d6-2ca3-4854-8d44-f2da05671734 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:23.946436 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-3352b1d6-2ca3-4854-8d44-f2da05671734 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5" status: 200 len: 1313 microversion: 2.1 time: 0.219992 Jul 14 17:54:23.947507 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 132/336] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:23 2022] GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:24.393562 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-46fa4816-2110-4b0d-aed9-9072bd5c662c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:24.394153 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-46fa4816-2110-4b0d-aed9-9072bd5c662c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:24.400476 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-46fa4816-2110-4b0d-aed9-9072bd5c662c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:24.400937 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-46fa4816-2110-4b0d-aed9-9072bd5c662c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:24.401715 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-46fa4816-2110-4b0d-aed9-9072bd5c662c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:24.402179 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-46fa4816-2110-4b0d-aed9-9072bd5c662c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:24.558008 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-46fa4816-2110-4b0d-aed9-9072bd5c662c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:24.567150 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-46fa4816-2110-4b0d-aed9-9072bd5c662c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.176490 Jul 14 17:54:24.567852 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 205/337] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:24 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:24.891218 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-89b3ab3f-4bc3-4c66-9ac8-ab1b7b62be0c tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] Calling method '.version_select at 0x7f1380133790>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:24.941219 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-89b3ab3f-4bc3-4c66-9ac8-ab1b7b62be0c tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/e8626cdf-0caf-4bed-b961-6b1b49acacac" status: 200 len: 346 microversion: 2.1 time: 0.054031 Jul 14 17:54:24.941898 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 133/338] 10.222.0.64 () {58 vars in 1244 bytes} [Thu Jul 14 17:54:24 2022] GET /compute/v2.1/os-volumes/e8626cdf-0caf-4bed-b961-6b1b49acacac => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:54:24.953174 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-dbfd46f7-0430-4a1e-859b-2a2bdb804c37 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] Action: 'create', calling method: .version_select at 0x7f13802fb550>, body: {"snapshot": {"volume_id": "e8626cdf-0caf-4bed-b961-6b1b49acacac", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-471391357"}} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:54:24.962772 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-3952b347-96b7-4aef-87eb-473a6152d1c2 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:24.963615 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-3952b347-96b7-4aef-87eb-473a6152d1c2 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: c69458a5-5cab-40fc-bf93-332204bebcd5] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:24.970014 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3952b347-96b7-4aef-87eb-473a6152d1c2 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:24.970474 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3952b347-96b7-4aef-87eb-473a6152d1c2 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:24.971746 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3952b347-96b7-4aef-87eb-473a6152d1c2 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:24.972259 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3952b347-96b7-4aef-87eb-473a6152d1c2 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:25.130460 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-3952b347-96b7-4aef-87eb-473a6152d1c2 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:25.133919 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-dbfd46f7-0430-4a1e-859b-2a2bdb804c37 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] 10.222.0.64 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.184271 Jul 14 17:54:25.135235 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 206/339] 10.222.0.64 () {60 vars in 1161 bytes} [Thu Jul 14 17:54:24 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:54:25.139083 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-3952b347-96b7-4aef-87eb-473a6152d1c2 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5" status: 200 len: 1313 microversion: 2.1 time: 0.180305 Jul 14 17:54:25.149760 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 134/340] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:24 2022] GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5 => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:54:25.151193 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-639beae2-396b-4086-8f62-8c21278260d6 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] Calling method '.version_select at 0x7f1380175940>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:25.189710 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-639beae2-396b-4086-8f62-8c21278260d6 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/32ec5fa3-3580-4f3c-a434-cc03c81ebbcf" status: 200 len: 286 microversion: 2.1 time: 0.048727 Jul 14 17:54:25.190341 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 207/341] 10.222.0.64 () {58 vars in 1250 bytes} [Thu Jul 14 17:54:25 2022] GET /compute/v2.1/os-snapshots/32ec5fa3-3580-4f3c-a434-cc03c81ebbcf => generated 286 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:54:25.203699 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-8d05682b-2c89-475e-a252-91a32ceeaa3e tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] Calling method '.version_select at 0x7f1380238ca0>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:25.237918 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-8d05682b-2c89-475e-a252-91a32ceeaa3e tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.039000 Jul 14 17:54:25.238488 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 135/342] 10.222.0.64 () {58 vars in 1139 bytes} [Thu Jul 14 17:54:25 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:54:25.248536 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-5964687c-7e2e-4197-b94e-3bbe08a180dd tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] Calling method '.version_select at 0x7f13801759d0>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:25.281244 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-5964687c-7e2e-4197-b94e-3bbe08a180dd tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/32ec5fa3-3580-4f3c-a434-cc03c81ebbcf" status: 200 len: 286 microversion: 2.1 time: 0.036434 Jul 14 17:54:25.281819 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 208/343] 10.222.0.64 () {58 vars in 1250 bytes} [Thu Jul 14 17:54:25 2022] GET /compute/v2.1/os-snapshots/32ec5fa3-3580-4f3c-a434-cc03c81ebbcf => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:54:25.586427 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-ff5785e4-62d7-4ac6-ad4a-2e299f87ffd5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:25.587215 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-ff5785e4-62d7-4ac6-ad4a-2e299f87ffd5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:25.593840 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ff5785e4-62d7-4ac6-ad4a-2e299f87ffd5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:25.594294 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ff5785e4-62d7-4ac6-ad4a-2e299f87ffd5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:25.595071 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ff5785e4-62d7-4ac6-ad4a-2e299f87ffd5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:25.595508 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ff5785e4-62d7-4ac6-ad4a-2e299f87ffd5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:25.736750 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-ff5785e4-62d7-4ac6-ad4a-2e299f87ffd5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:25.744253 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-ff5785e4-62d7-4ac6-ad4a-2e299f87ffd5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.163142 Jul 14 17:54:25.744815 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 136/344] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:25 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:26.154503 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell0:SELECT=2 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:54:26.155889 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell0:SELECT=6 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:54:26.160914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-66a589c2-3a68-4892-8c16-99eb61a192b9 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:26.161524 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-66a589c2-3a68-4892-8c16-99eb61a192b9 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: c69458a5-5cab-40fc-bf93-332204bebcd5] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:26.168788 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-66a589c2-3a68-4892-8c16-99eb61a192b9 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:26.169241 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-66a589c2-3a68-4892-8c16-99eb61a192b9 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:26.170027 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-66a589c2-3a68-4892-8c16-99eb61a192b9 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:26.170468 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-66a589c2-3a68-4892-8c16-99eb61a192b9 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:26.292933 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-564f3fe8-01a4-4441-b10b-ab682d92ab57 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] Calling method '.version_select at 0x7f1380311790>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:26.300082 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell0:SELECT=2 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:54:26.301984 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-66a589c2-3a68-4892-8c16-99eb61a192b9 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:26.309795 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-66a589c2-3a68-4892-8c16-99eb61a192b9 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5" status: 200 len: 1313 microversion: 2.1 time: 0.156223 Jul 14 17:54:26.310344 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 209/345] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:26 2022] GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:26.326033 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-564f3fe8-01a4-4441-b10b-ab682d92ab57 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/32ec5fa3-3580-4f3c-a434-cc03c81ebbcf" status: 200 len: 286 microversion: 2.1 time: 0.036880 Jul 14 17:54:26.326631 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 137/346] 10.222.0.64 () {58 vars in 1250 bytes} [Thu Jul 14 17:54:26 2022] GET /compute/v2.1/os-snapshots/32ec5fa3-3580-4f3c-a434-cc03c81ebbcf => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 17:54:26.761859 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-f25512fc-dd68-474d-b610-45fecb2d5ac3 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:26.762378 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-f25512fc-dd68-474d-b610-45fecb2d5ac3 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:26.768490 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f25512fc-dd68-474d-b610-45fecb2d5ac3 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:26.768943 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f25512fc-dd68-474d-b610-45fecb2d5ac3 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:26.769710 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f25512fc-dd68-474d-b610-45fecb2d5ac3 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:26.770149 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f25512fc-dd68-474d-b610-45fecb2d5ac3 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:26.900593 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-f25512fc-dd68-474d-b610-45fecb2d5ac3 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:26.908175 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-f25512fc-dd68-474d-b610-45fecb2d5ac3 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.150186 Jul 14 17:54:26.909251 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 210/347] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:26 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:27.327517 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-de4c9a74-fbb2-406c-a31d-737532743883 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:27.328201 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-de4c9a74-fbb2-406c-a31d-737532743883 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: c69458a5-5cab-40fc-bf93-332204bebcd5] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:27.335712 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-de4c9a74-fbb2-406c-a31d-737532743883 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:27.336218 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-de4c9a74-fbb2-406c-a31d-737532743883 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:27.337025 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-de4c9a74-fbb2-406c-a31d-737532743883 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:27.337461 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-de4c9a74-fbb2-406c-a31d-737532743883 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:27.338375 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-e603ba62-8761-4952-ba7f-dd9bf8ef998c tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] Calling method '.version_select at 0x7f13801d79d0>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:27.369812 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-e603ba62-8761-4952-ba7f-dd9bf8ef998c tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/32ec5fa3-3580-4f3c-a434-cc03c81ebbcf" status: 200 len: 286 microversion: 2.1 time: 0.035609 Jul 14 17:54:27.370528 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 211/348] 10.222.0.64 () {58 vars in 1250 bytes} [Thu Jul 14 17:54:27 2022] GET /compute/v2.1/os-snapshots/32ec5fa3-3580-4f3c-a434-cc03c81ebbcf => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 17:54:27.469564 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-de4c9a74-fbb2-406c-a31d-737532743883 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:27.477114 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-de4c9a74-fbb2-406c-a31d-737532743883 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5" status: 200 len: 1313 microversion: 2.1 time: 0.153964 Jul 14 17:54:27.477691 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 138/349] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:27 2022] GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:27.926215 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-f8035eb0-c520-4872-a915-eed789e4ba4f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:27.926732 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-f8035eb0-c520-4872-a915-eed789e4ba4f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:27.933653 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f8035eb0-c520-4872-a915-eed789e4ba4f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:27.934560 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f8035eb0-c520-4872-a915-eed789e4ba4f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:27.934965 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f8035eb0-c520-4872-a915-eed789e4ba4f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:27.935411 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f8035eb0-c520-4872-a915-eed789e4ba4f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:28.066546 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-f8035eb0-c520-4872-a915-eed789e4ba4f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:28.074423 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-f8035eb0-c520-4872-a915-eed789e4ba4f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.152748 Jul 14 17:54:28.075000 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 212/350] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:27 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:28.382403 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-894fef42-0cff-4bab-8945-7f081c1fe4e5 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] Calling method '.version_select at 0x7f1380238280>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:28.412204 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-894fef42-0cff-4bab-8945-7f081c1fe4e5 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/32ec5fa3-3580-4f3c-a434-cc03c81ebbcf" status: 200 len: 286 microversion: 2.1 time: 0.034248 Jul 14 17:54:28.412777 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 139/351] 10.222.0.64 () {58 vars in 1250 bytes} [Thu Jul 14 17:54:28 2022] GET /compute/v2.1/os-snapshots/32ec5fa3-3580-4f3c-a434-cc03c81ebbcf => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:54:28.494563 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-3ad57773-e791-4354-befd-2a024ad84aea tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:28.495171 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-3ad57773-e791-4354-befd-2a024ad84aea tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: c69458a5-5cab-40fc-bf93-332204bebcd5] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:28.501513 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3ad57773-e791-4354-befd-2a024ad84aea tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:28.501965 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3ad57773-e791-4354-befd-2a024ad84aea tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:28.502740 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3ad57773-e791-4354-befd-2a024ad84aea tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:28.503176 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3ad57773-e791-4354-befd-2a024ad84aea tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:28.634072 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-3ad57773-e791-4354-befd-2a024ad84aea tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:28.641576 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-3ad57773-e791-4354-befd-2a024ad84aea tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5" status: 200 len: 1313 microversion: 2.1 time: 0.150844 Jul 14 17:54:28.642142 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 213/352] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:28 2022] GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:29.091209 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-755fb94e-3c6f-4188-a1bf-2c4409cef1ab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:29.091775 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-755fb94e-3c6f-4188-a1bf-2c4409cef1ab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:29.093818 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_api:SELECT=50 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:54:29.099580 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-755fb94e-3c6f-4188-a1bf-2c4409cef1ab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:29.100058 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-755fb94e-3c6f-4188-a1bf-2c4409cef1ab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:29.100850 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-755fb94e-3c6f-4188-a1bf-2c4409cef1ab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:29.101290 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-755fb94e-3c6f-4188-a1bf-2c4409cef1ab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:29.229820 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-755fb94e-3c6f-4188-a1bf-2c4409cef1ab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:29.237913 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-755fb94e-3c6f-4188-a1bf-2c4409cef1ab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.150214 Jul 14 17:54:29.238483 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 140/353] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:29 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:29.424127 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-2edec1be-b107-43ab-9e0b-943ebfe05aa6 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] Calling method '.version_select at 0x7f1380175e50>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:29.453806 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-2edec1be-b107-43ab-9e0b-943ebfe05aa6 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/32ec5fa3-3580-4f3c-a434-cc03c81ebbcf" status: 200 len: 286 microversion: 2.1 time: 0.033567 Jul 14 17:54:29.454384 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 214/354] 10.222.0.64 () {58 vars in 1250 bytes} [Thu Jul 14 17:54:29 2022] GET /compute/v2.1/os-snapshots/32ec5fa3-3580-4f3c-a434-cc03c81ebbcf => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:54:29.658474 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-e0641cea-5672-48ae-87aa-ec391819ad5e tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:29.659659 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-e0641cea-5672-48ae-87aa-ec391819ad5e tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: c69458a5-5cab-40fc-bf93-332204bebcd5] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:29.666250 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e0641cea-5672-48ae-87aa-ec391819ad5e tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:29.666705 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e0641cea-5672-48ae-87aa-ec391819ad5e tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:29.667473 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e0641cea-5672-48ae-87aa-ec391819ad5e tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:29.667914 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e0641cea-5672-48ae-87aa-ec391819ad5e tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:29.803969 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-e0641cea-5672-48ae-87aa-ec391819ad5e tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:29.811417 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-e0641cea-5672-48ae-87aa-ec391819ad5e tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5" status: 200 len: 1313 microversion: 2.1 time: 0.156866 Jul 14 17:54:29.811998 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 141/355] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:29 2022] GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:30.255244 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-1b1dbc0d-e497-47dc-b107-d41be01ba9e6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:30.255859 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-1b1dbc0d-e497-47dc-b107-d41be01ba9e6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:30.262215 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1b1dbc0d-e497-47dc-b107-d41be01ba9e6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:30.262670 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1b1dbc0d-e497-47dc-b107-d41be01ba9e6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:30.263489 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1b1dbc0d-e497-47dc-b107-d41be01ba9e6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:30.263963 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1b1dbc0d-e497-47dc-b107-d41be01ba9e6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:30.395479 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-1b1dbc0d-e497-47dc-b107-d41be01ba9e6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:30.402988 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-1b1dbc0d-e497-47dc-b107-d41be01ba9e6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.152164 Jul 14 17:54:30.403564 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 215/356] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:30 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:30.465487 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-269852a3-4f2d-41ec-bd81-79c5d166fb59 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] Calling method '.version_select at 0x7f138021a310>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:30.494832 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-269852a3-4f2d-41ec-bd81-79c5d166fb59 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/32ec5fa3-3580-4f3c-a434-cc03c81ebbcf" status: 200 len: 286 microversion: 2.1 time: 0.033110 Jul 14 17:54:30.495403 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 142/357] 10.222.0.64 () {58 vars in 1250 bytes} [Thu Jul 14 17:54:30 2022] GET /compute/v2.1/os-snapshots/32ec5fa3-3580-4f3c-a434-cc03c81ebbcf => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:54:30.828708 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-78b7ee7d-30ad-4d39-9fec-57b881350d00 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:30.829491 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-78b7ee7d-30ad-4d39-9fec-57b881350d00 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: c69458a5-5cab-40fc-bf93-332204bebcd5] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:30.836297 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-78b7ee7d-30ad-4d39-9fec-57b881350d00 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:30.836754 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-78b7ee7d-30ad-4d39-9fec-57b881350d00 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:30.837623 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-78b7ee7d-30ad-4d39-9fec-57b881350d00 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:30.837982 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-78b7ee7d-30ad-4d39-9fec-57b881350d00 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:30.973573 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-78b7ee7d-30ad-4d39-9fec-57b881350d00 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:30.981179 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-78b7ee7d-30ad-4d39-9fec-57b881350d00 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5" status: 200 len: 1313 microversion: 2.1 time: 0.156560 Jul 14 17:54:30.981770 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 216/358] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:30 2022] GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:31.420469 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-98661b62-d757-425d-bc9a-4d9704ca81a3 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:31.421076 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-98661b62-d757-425d-bc9a-4d9704ca81a3 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:31.427776 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-98661b62-d757-425d-bc9a-4d9704ca81a3 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:31.428247 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-98661b62-d757-425d-bc9a-4d9704ca81a3 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:31.429016 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-98661b62-d757-425d-bc9a-4d9704ca81a3 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:31.429451 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-98661b62-d757-425d-bc9a-4d9704ca81a3 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:31.506308 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-f412eb76-86f4-4071-8dc7-0250b4bd68e1 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] Calling method '.version_select at 0x7f1380175e50>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:31.553541 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-f412eb76-86f4-4071-8dc7-0250b4bd68e1 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/32ec5fa3-3580-4f3c-a434-cc03c81ebbcf" status: 200 len: 286 microversion: 2.1 time: 0.051368 Jul 14 17:54:31.554627 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 217/359] 10.222.0.64 () {58 vars in 1250 bytes} [Thu Jul 14 17:54:31 2022] GET /compute/v2.1/os-snapshots/32ec5fa3-3580-4f3c-a434-cc03c81ebbcf => generated 286 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:54:31.604608 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-98661b62-d757-425d-bc9a-4d9704ca81a3 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:31.613889 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-98661b62-d757-425d-bc9a-4d9704ca81a3 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.197700 Jul 14 17:54:31.614699 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 143/360] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:31 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:31.998450 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-a6a1719f-4924-49a3-9ced-2efe7b032fe3 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:31.999062 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-a6a1719f-4924-49a3-9ced-2efe7b032fe3 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: c69458a5-5cab-40fc-bf93-332204bebcd5] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:32.005192 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a6a1719f-4924-49a3-9ced-2efe7b032fe3 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:32.005645 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a6a1719f-4924-49a3-9ced-2efe7b032fe3 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:32.006415 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a6a1719f-4924-49a3-9ced-2efe7b032fe3 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:32.006854 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a6a1719f-4924-49a3-9ced-2efe7b032fe3 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:32.135145 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-a6a1719f-4924-49a3-9ced-2efe7b032fe3 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:32.142791 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-a6a1719f-4924-49a3-9ced-2efe7b032fe3 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5" status: 200 len: 1313 microversion: 2.1 time: 0.148167 Jul 14 17:54:32.143866 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 218/361] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:31 2022] GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:54:32.565805 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-234a1659-d231-432b-a0c1-e2db592e0587 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] Calling method '.version_select at 0x7f138021a790>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:32.596342 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-234a1659-d231-432b-a0c1-e2db592e0587 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/32ec5fa3-3580-4f3c-a434-cc03c81ebbcf" status: 200 len: 286 microversion: 2.1 time: 0.034532 Jul 14 17:54:32.597539 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 144/362] 10.222.0.64 () {58 vars in 1250 bytes} [Thu Jul 14 17:54:32 2022] GET /compute/v2.1/os-snapshots/32ec5fa3-3580-4f3c-a434-cc03c81ebbcf => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 17:54:32.631142 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-6d7e0cce-07d5-4c0d-8d24-8b4f992545d8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:32.631768 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-6d7e0cce-07d5-4c0d-8d24-8b4f992545d8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:32.637781 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6d7e0cce-07d5-4c0d-8d24-8b4f992545d8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:32.638237 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6d7e0cce-07d5-4c0d-8d24-8b4f992545d8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:32.639014 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6d7e0cce-07d5-4c0d-8d24-8b4f992545d8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:32.639460 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6d7e0cce-07d5-4c0d-8d24-8b4f992545d8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:32.773984 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-6d7e0cce-07d5-4c0d-8d24-8b4f992545d8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:32.781491 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-6d7e0cce-07d5-4c0d-8d24-8b4f992545d8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.155020 Jul 14 17:54:32.782074 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 219/363] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:32 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:33.160768 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-bceee734-35b7-492e-87b8-43b459d7e4de tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:33.161389 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-bceee734-35b7-492e-87b8-43b459d7e4de tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: c69458a5-5cab-40fc-bf93-332204bebcd5] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:33.167590 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-bceee734-35b7-492e-87b8-43b459d7e4de tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:33.168013 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-bceee734-35b7-492e-87b8-43b459d7e4de tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:33.168775 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-bceee734-35b7-492e-87b8-43b459d7e4de tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:33.169205 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-bceee734-35b7-492e-87b8-43b459d7e4de tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:33.297066 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-bceee734-35b7-492e-87b8-43b459d7e4de tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:33.304525 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-bceee734-35b7-492e-87b8-43b459d7e4de tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5" status: 200 len: 1313 microversion: 2.1 time: 0.148164 Jul 14 17:54:33.305097 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 145/364] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:33 2022] GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:33.608841 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-ff995834-81c0-4c8b-a2da-43d71163d7df tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] Calling method '.version_select at 0x7f13801d7820>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:33.640862 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-ff995834-81c0-4c8b-a2da-43d71163d7df tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/32ec5fa3-3580-4f3c-a434-cc03c81ebbcf" status: 200 len: 287 microversion: 2.1 time: 0.035373 Jul 14 17:54:33.641830 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 220/365] 10.222.0.64 () {58 vars in 1250 bytes} [Thu Jul 14 17:54:33 2022] GET /compute/v2.1/os-snapshots/32ec5fa3-3580-4f3c-a434-cc03c81ebbcf => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:54:33.653058 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-3cac19b6-09d9-4903-8ef4-b1cda27685c9 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] Calling method '.version_select at 0x7f138154a5e0>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:33.720653 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-3cac19b6-09d9-4903-8ef4-b1cda27685c9 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] 10.222.0.64 "DELETE /compute/v2.1/os-snapshots/32ec5fa3-3580-4f3c-a434-cc03c81ebbcf" status: 202 len: 0 microversion: 2.1 time: 0.071453 Jul 14 17:54:33.721324 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 146/366] 10.222.0.64 () {58 vars in 1253 bytes} [Thu Jul 14 17:54:33 2022] DELETE /compute/v2.1/os-snapshots/32ec5fa3-3580-4f3c-a434-cc03c81ebbcf => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 17:54:33.731809 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-cc7abfa3-0067-4bd6-bff8-5e3932e52451 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] Calling method '.version_select at 0x7f13803c3ca0>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:33.766938 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-cc7abfa3-0067-4bd6-bff8-5e3932e52451 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/32ec5fa3-3580-4f3c-a434-cc03c81ebbcf" status: 200 len: 286 microversion: 2.1 time: 0.040059 Jul 14 17:54:33.767519 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 221/367] 10.222.0.64 () {58 vars in 1250 bytes} [Thu Jul 14 17:54:33 2022] GET /compute/v2.1/os-snapshots/32ec5fa3-3580-4f3c-a434-cc03c81ebbcf => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 17:54:33.799391 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-e1dea6c2-c35e-4562-b402-0b4d07f3005d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:33.800065 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-e1dea6c2-c35e-4562-b402-0b4d07f3005d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:33.806729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e1dea6c2-c35e-4562-b402-0b4d07f3005d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:33.807182 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e1dea6c2-c35e-4562-b402-0b4d07f3005d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:33.807986 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e1dea6c2-c35e-4562-b402-0b4d07f3005d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:33.808424 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e1dea6c2-c35e-4562-b402-0b4d07f3005d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:33.958253 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-e1dea6c2-c35e-4562-b402-0b4d07f3005d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:33.966012 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-e1dea6c2-c35e-4562-b402-0b4d07f3005d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.170466 Jul 14 17:54:33.966512 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 147/368] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:33 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:34.321974 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-557e6541-bb41-447f-a730-dbf1f4d6c751 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:34.322489 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-557e6541-bb41-447f-a730-dbf1f4d6c751 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: c69458a5-5cab-40fc-bf93-332204bebcd5] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:34.324639 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:54:34.331042 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-557e6541-bb41-447f-a730-dbf1f4d6c751 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:34.331483 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-557e6541-bb41-447f-a730-dbf1f4d6c751 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:34.332274 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-557e6541-bb41-447f-a730-dbf1f4d6c751 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:34.332711 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-557e6541-bb41-447f-a730-dbf1f4d6c751 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:34.473749 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-557e6541-bb41-447f-a730-dbf1f4d6c751 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:34.481353 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-557e6541-bb41-447f-a730-dbf1f4d6c751 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5" status: 200 len: 1313 microversion: 2.1 time: 0.163242 Jul 14 17:54:34.481931 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 222/369] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:34 2022] GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:34.778605 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-745574f3-1f87-4aa2-aedc-febc57b30af7 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] Calling method '.version_select at 0x7f138021aaf0>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:34.810148 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-745574f3-1f87-4aa2-aedc-febc57b30af7 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/32ec5fa3-3580-4f3c-a434-cc03c81ebbcf" status: 200 len: 286 microversion: 2.1 time: 0.035288 Jul 14 17:54:34.810727 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 148/370] 10.222.0.64 () {58 vars in 1250 bytes} [Thu Jul 14 17:54:34 2022] GET /compute/v2.1/os-snapshots/32ec5fa3-3580-4f3c-a434-cc03c81ebbcf => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:54:34.983067 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-ad1f9dae-53ff-4c42-ba22-f757a1994a6c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:34.983588 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-ad1f9dae-53ff-4c42-ba22-f757a1994a6c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:34.989716 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ad1f9dae-53ff-4c42-ba22-f757a1994a6c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:34.990165 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ad1f9dae-53ff-4c42-ba22-f757a1994a6c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:34.990932 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ad1f9dae-53ff-4c42-ba22-f757a1994a6c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:34.991371 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ad1f9dae-53ff-4c42-ba22-f757a1994a6c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:35.124347 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-ad1f9dae-53ff-4c42-ba22-f757a1994a6c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:35.131850 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-ad1f9dae-53ff-4c42-ba22-f757a1994a6c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.152700 Jul 14 17:54:35.132450 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 223/371] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:34 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:35.498708 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-badae303-8a74-480a-b7d5-e3f4450298e0 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:35.499668 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-badae303-8a74-480a-b7d5-e3f4450298e0 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: c69458a5-5cab-40fc-bf93-332204bebcd5] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:35.507543 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-badae303-8a74-480a-b7d5-e3f4450298e0 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:35.508138 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-badae303-8a74-480a-b7d5-e3f4450298e0 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:35.508990 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-badae303-8a74-480a-b7d5-e3f4450298e0 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:35.509500 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-badae303-8a74-480a-b7d5-e3f4450298e0 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:35.533767 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [req-b8da6b95-a99c-4107-90fa-b5faed1f489d req-e0859d90-dd26-4bbf-bb9e-4cb34325f738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c69458a5-5cab-40fc-bf93-332204bebcd5", "name": "network-vif-plugged", "status": "completed", "tag": "79249223-593f-4a5b-8226-3f41d2e34e6a"}]} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:54:35.545065 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-b8da6b95-a99c-4107-90fa-b5faed1f489d req-e0859d90-dd26-4bbf-bb9e-4cb34325f738 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:35.545772 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-b8da6b95-a99c-4107-90fa-b5faed1f489d req-e0859d90-dd26-4bbf-bb9e-4cb34325f738 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:35.558796 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.compute.server_external_events [req-b8da6b95-a99c-4107-90fa-b5faed1f489d req-e0859d90-dd26-4bbf-bb9e-4cb34325f738 service nova] Creating event network-vif-plugged:79249223-593f-4a5b-8226-3f41d2e34e6a for instance c69458a5-5cab-40fc-bf93-332204bebcd5 on hv-cinder-84989 Jul 14 17:54:35.570056 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [req-b8da6b95-a99c-4107-90fa-b5faed1f489d req-e0859d90-dd26-4bbf-bb9e-4cb34325f738 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039877 Jul 14 17:54:35.571319 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 224/372] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 17:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 17:54:35.680040 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-badae303-8a74-480a-b7d5-e3f4450298e0 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:35.692892 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-badae303-8a74-480a-b7d5-e3f4450298e0 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5" status: 200 len: 1313 microversion: 2.1 time: 0.197623 Jul 14 17:54:35.693641 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 149/373] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:35 2022] GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5 => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:35.823893 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-2e60dc74-fd6a-4fff-9558-08aa7ab16c19 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] Calling method '.version_select at 0x7f1380175550>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:35.864218 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.wsgi [None req-2e60dc74-fd6a-4fff-9558-08aa7ab16c19 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] HTTP exception thrown: Snapshot 32ec5fa3-3580-4f3c-a434-cc03c81ebbcf could not be found. Jul 14 17:54:35.869641 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-2e60dc74-fd6a-4fff-9558-08aa7ab16c19 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] Request method failure captured: Jul 14 17:54:35.869641 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: request: GET /compute/v2.1/os-snapshots/32ec5fa3-3580-4f3c-a434-cc03c81ebbcf HTTP/1.1 Jul 14 17:54:35.869641 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept: application/json Jul 14 17:54:35.869641 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept-Encoding: identity Jul 14 17:54:35.869641 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Connection: close Jul 14 17:54:35.869641 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Length: 0 Jul 14 17:54:35.869641 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Type: application/json Jul 14 17:54:35.869641 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Host: 10.222.0.64 Jul 14 17:54:35.869641 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Openstack-System-Scope: None Jul 14 17:54:35.869641 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: User-Agent: python-urllib3/1.26.9 Jul 14 17:54:35.869641 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Auth-Token: gAAAAABi0FhOgAWO9k7lc2CrqMJIXRhdBn9cNxatfzPu5RGtwfgoO5aL0ObXc_UAJTUtaEjurePOvTrAQbO2TkY78c_LhRMVp1aeqMFjnPZ7rb2OK58A7-5JWDuao7AmO8WeQ4GSWH04kRJg4-Je2AuMDK3hTogLUvHV5-H5M2tm5BeKzRivKHI Jul 14 17:54:35.869641 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Id: None Jul 14 17:54:35.869641 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Name: None Jul 14 17:54:35.869641 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Identity-Status: Confirmed Jul 14 17:54:35.869641 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Is-Admin-Project: True Jul 14 17:54:35.869641 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Id: default Jul 14 17:54:35.869641 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Name: Default Jul 14 17:54:35.869641 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Id: 8b1103c5cdec41ef85f6cacbe0ec7f86 Jul 14 17:54:35.869641 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-534730919 Jul 14 17:54:35.869641 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Role: reader,member Jul 14 17:54:35.869641 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Roles: reader,member Jul 14 17:54:35.871241 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8b1103c5cdec41ef85f6cacbe0ec7f86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/8b1103c5cdec41ef85f6cacbe0ec7f86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8b1103c5cdec41ef85f6cacbe0ec7f86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_8b1103c5cdec41ef85f6cacbe0ec7f86", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 17:54:35.871241 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant: tempest-VolumesSnapshotsTestJSON-534730919 Jul 14 17:54:35.871241 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Id: 8b1103c5cdec41ef85f6cacbe0ec7f86 Jul 14 17:54:35.871241 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-534730919 Jul 14 17:54:35.871241 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User: tempest-VolumesSnapshotsTestJSON-534730919-project Jul 14 17:54:35.871241 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Id: default Jul 14 17:54:35.871241 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Name: Default Jul 14 17:54:35.871241 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Id: 1b9b8efaf17643e5b27f295e982162a5 Jul 14 17:54:35.871241 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Name: tempest-VolumesSnapshotsTestJSON-534730919-project Jul 14 17:54:35.871241 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: method: Jul 14 17:54:35.871241 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: exception: Snapshot 32ec5fa3-3580-4f3c-a434-cc03c81ebbcf could not be found. Jul 14 17:54:35.871241 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: action_args: {'id': '32ec5fa3-3580-4f3c-a434-cc03c81ebbcf'} Jul 14 17:54:35.871241 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 17:54:35.872270 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:54:35.872270 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 14 17:54:35.872270 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 14 17:54:35.872270 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 14 17:54:35.872270 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 14 17:54:35.872270 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 14 17:54:35.872270 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 14 17:54:35.872270 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 17:54:35.872270 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 17:54:35.872270 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 17:54:35.872270 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 17:54:35.872270 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 17:54:35.872270 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 17:54:35.872270 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 17:54:35.872270 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 17:54:35.872270 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 32ec5fa3-3580-4f3c-a434-cc03c81ebbcf could not be found. (HTTP 404) (Request-ID: req-b150a9bd-5197-4d18-9876-249629eb06fc) Jul 14 17:54:35.872270 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:54:35.872270 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:54:35.874312 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:54:35.874312 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:54:35.874312 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 14 17:54:35.874312 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 14 17:54:35.874312 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 17:54:35.874312 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 17:54:35.874312 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 14 17:54:35.874312 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 14 17:54:35.874312 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 17:54:35.874312 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 17:54:35.874312 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 14 17:54:35.874312 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 14 17:54:35.874312 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 14 17:54:35.874312 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 14 17:54:35.874312 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 14 17:54:35.874312 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 14 17:54:35.874312 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 17:54:35.874312 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 17:54:35.874312 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 17:54:35.876904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 17:54:35.876904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 17:54:35.876904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 17:54:35.876904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 17:54:35.876904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 17:54:35.876904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 32ec5fa3-3580-4f3c-a434-cc03c81ebbcf could not be found. Jul 14 17:54:35.876904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:54:35.876904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:54:35.876904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:54:35.876904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:54:35.876904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:54:35.876904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:54:35.876904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 17:54:35.876904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 17:54:35.876904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 17:54:35.876904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 17:54:35.876904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 17:54:35.876904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 17:54:35.876904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 14 17:54:35.876904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 17:54:35.879850 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 32ec5fa3-3580-4f3c-a434-cc03c81ebbcf could not be found. Jul 14 17:54:35.879850 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:54:35.879850 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:54:35.879850 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:54:35.879850 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:54:35.879850 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:54:35.879850 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:54:35.879850 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 17:54:35.879850 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 17:54:35.879850 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 32ec5fa3-3580-4f3c-a434-cc03c81ebbcf could not be found. Jul 14 17:54:35.879850 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:54:35.883701 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-2e60dc74-fd6a-4fff-9558-08aa7ab16c19 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] Returning 404 to user: Snapshot 32ec5fa3-3580-4f3c-a434-cc03c81ebbcf could not be found. {{(pid=129471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 17:54:35.883701 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-2e60dc74-fd6a-4fff-9558-08aa7ab16c19 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/32ec5fa3-3580-4f3c-a434-cc03c81ebbcf" status: 404 len: 111 microversion: 2.1 time: 0.062841 Jul 14 17:54:35.883701 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 225/374] 10.222.0.64 () {58 vars in 1250 bytes} [Thu Jul 14 17:54:35 2022] GET /compute/v2.1/os-snapshots/32ec5fa3-3580-4f3c-a434-cc03c81ebbcf => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 17:54:35.891381 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-78610ddb-bf2a-4cd6-a450-7086643b8d46 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] Calling method '.version_select at 0x7f1380083820>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:35.966366 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-78610ddb-bf2a-4cd6-a450-7086643b8d46 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/e8626cdf-0caf-4bed-b961-6b1b49acacac" status: 202 len: 0 microversion: 2.1 time: 0.079015 Jul 14 17:54:35.967078 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 150/375] 10.222.0.64 () {58 vars in 1247 bytes} [Thu Jul 14 17:54:35 2022] DELETE /compute/v2.1/os-volumes/e8626cdf-0caf-4bed-b961-6b1b49acacac => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 17:54:35.975971 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-cf5dd45e-7b88-4333-81fb-1b5bfdfc1fdc tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] Calling method '.version_select at 0x7f13801d7790>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:36.025153 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-cf5dd45e-7b88-4333-81fb-1b5bfdfc1fdc tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/e8626cdf-0caf-4bed-b961-6b1b49acacac" status: 200 len: 345 microversion: 2.1 time: 0.053421 Jul 14 17:54:36.026057 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 226/376] 10.222.0.64 () {58 vars in 1244 bytes} [Thu Jul 14 17:54:35 2022] GET /compute/v2.1/os-volumes/e8626cdf-0caf-4bed-b961-6b1b49acacac => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:54:36.148965 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-157f513c-a06f-4b2e-99be-eb22fdb7226c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:36.149576 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-157f513c-a06f-4b2e-99be-eb22fdb7226c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:36.155696 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-157f513c-a06f-4b2e-99be-eb22fdb7226c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:36.156181 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-157f513c-a06f-4b2e-99be-eb22fdb7226c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:36.156983 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-157f513c-a06f-4b2e-99be-eb22fdb7226c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:36.157425 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-157f513c-a06f-4b2e-99be-eb22fdb7226c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:36.288915 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-157f513c-a06f-4b2e-99be-eb22fdb7226c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:36.296596 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-157f513c-a06f-4b2e-99be-eb22fdb7226c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.151582 Jul 14 17:54:36.297167 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 151/377] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:36 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:36.719719 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-cfceec0e-d31a-4fe1-91df-d14a69dccbf9 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:36.720489 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-cfceec0e-d31a-4fe1-91df-d14a69dccbf9 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: c69458a5-5cab-40fc-bf93-332204bebcd5] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:36.727513 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-cfceec0e-d31a-4fe1-91df-d14a69dccbf9 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:36.727976 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-cfceec0e-d31a-4fe1-91df-d14a69dccbf9 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:36.728765 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-cfceec0e-d31a-4fe1-91df-d14a69dccbf9 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:36.729210 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-cfceec0e-d31a-4fe1-91df-d14a69dccbf9 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:36.749480 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=100 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:54:36.872935 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-cfceec0e-d31a-4fe1-91df-d14a69dccbf9 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:36.880953 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-cfceec0e-d31a-4fe1-91df-d14a69dccbf9 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5" status: 200 len: 1313 microversion: 2.1 time: 0.165186 Jul 14 17:54:36.881534 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 227/378] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:36 2022] GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:37.038722 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-6b084dbc-8102-4715-a7ec-5277cc6bb903 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] Calling method '.version_select at 0x7f1380083310>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:37.077914 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.wsgi [None req-6b084dbc-8102-4715-a7ec-5277cc6bb903 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] HTTP exception thrown: Volume e8626cdf-0caf-4bed-b961-6b1b49acacac could not be found. Jul 14 17:54:37.080208 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-6b084dbc-8102-4715-a7ec-5277cc6bb903 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] Request method failure captured: Jul 14 17:54:37.080208 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: request: GET /compute/v2.1/os-volumes/e8626cdf-0caf-4bed-b961-6b1b49acacac HTTP/1.1 Jul 14 17:54:37.080208 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept: application/json Jul 14 17:54:37.080208 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept-Encoding: identity Jul 14 17:54:37.080208 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Connection: close Jul 14 17:54:37.080208 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Length: 0 Jul 14 17:54:37.080208 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Type: application/json Jul 14 17:54:37.080208 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Host: 10.222.0.64 Jul 14 17:54:37.080208 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Openstack-System-Scope: None Jul 14 17:54:37.080208 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: User-Agent: python-urllib3/1.26.9 Jul 14 17:54:37.080208 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Auth-Token: gAAAAABi0FhOgAWO9k7lc2CrqMJIXRhdBn9cNxatfzPu5RGtwfgoO5aL0ObXc_UAJTUtaEjurePOvTrAQbO2TkY78c_LhRMVp1aeqMFjnPZ7rb2OK58A7-5JWDuao7AmO8WeQ4GSWH04kRJg4-Je2AuMDK3hTogLUvHV5-H5M2tm5BeKzRivKHI Jul 14 17:54:37.080208 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Id: None Jul 14 17:54:37.080208 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Name: None Jul 14 17:54:37.080208 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Identity-Status: Confirmed Jul 14 17:54:37.080208 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Is-Admin-Project: True Jul 14 17:54:37.080208 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Id: default Jul 14 17:54:37.080208 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Name: Default Jul 14 17:54:37.080208 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Id: 8b1103c5cdec41ef85f6cacbe0ec7f86 Jul 14 17:54:37.080208 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-534730919 Jul 14 17:54:37.080208 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Role: reader,member Jul 14 17:54:37.080208 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Roles: reader,member Jul 14 17:54:37.082296 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8b1103c5cdec41ef85f6cacbe0ec7f86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/8b1103c5cdec41ef85f6cacbe0ec7f86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8b1103c5cdec41ef85f6cacbe0ec7f86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_8b1103c5cdec41ef85f6cacbe0ec7f86", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 17:54:37.082296 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant: tempest-VolumesSnapshotsTestJSON-534730919 Jul 14 17:54:37.082296 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Id: 8b1103c5cdec41ef85f6cacbe0ec7f86 Jul 14 17:54:37.082296 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-534730919 Jul 14 17:54:37.082296 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User: tempest-VolumesSnapshotsTestJSON-534730919-project Jul 14 17:54:37.082296 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Id: default Jul 14 17:54:37.082296 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Name: Default Jul 14 17:54:37.082296 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Id: 1b9b8efaf17643e5b27f295e982162a5 Jul 14 17:54:37.082296 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Name: tempest-VolumesSnapshotsTestJSON-534730919-project Jul 14 17:54:37.082296 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: method: Jul 14 17:54:37.082296 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: exception: Volume e8626cdf-0caf-4bed-b961-6b1b49acacac could not be found. Jul 14 17:54:37.082296 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: action_args: {'id': 'e8626cdf-0caf-4bed-b961-6b1b49acacac'} Jul 14 17:54:37.082296 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 17:54:37.083199 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:54:37.083199 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 17:54:37.083199 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 17:54:37.083199 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 17:54:37.083199 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 17:54:37.083199 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 17:54:37.083199 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 17:54:37.083199 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 17:54:37.083199 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 17:54:37.083199 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 17:54:37.083199 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 17:54:37.083199 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 17:54:37.083199 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 17:54:37.083199 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 17:54:37.083199 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 17:54:37.083199 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e8626cdf-0caf-4bed-b961-6b1b49acacac could not be found. (HTTP 404) (Request-ID: req-5e6a9827-bf4b-452b-be45-c715b813338b) Jul 14 17:54:37.083199 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 17:54:37.083199 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:54:37.083199 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 17:54:37.084666 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:54:37.084666 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 17:54:37.084666 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 17:54:37.084666 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 17:54:37.084666 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 17:54:37.084666 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 17:54:37.084666 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 17:54:37.084666 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 17:54:37.084666 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 17:54:37.084666 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 17:54:37.084666 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 17:54:37.084666 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 17:54:37.084666 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 17:54:37.084666 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 17:54:37.084666 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 17:54:37.084666 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 17:54:37.084666 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 17:54:37.084666 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 17:54:37.084666 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 17:54:37.086043 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 17:54:37.086043 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 17:54:37.086043 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 17:54:37.086043 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 17:54:37.086043 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e8626cdf-0caf-4bed-b961-6b1b49acacac could not be found. Jul 14 17:54:37.086043 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 17:54:37.086043 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:54:37.086043 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 17:54:37.086043 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:54:37.086043 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:54:37.086043 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:54:37.086043 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 17:54:37.086043 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 17:54:37.086043 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 17:54:37.086043 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 17:54:37.086043 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 17:54:37.086043 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 17:54:37.086043 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 17:54:37.086043 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 17:54:37.087400 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e8626cdf-0caf-4bed-b961-6b1b49acacac could not be found. Jul 14 17:54:37.087400 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 17:54:37.087400 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:54:37.087400 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 17:54:37.087400 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:54:37.087400 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:54:37.087400 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:54:37.087400 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 17:54:37.087400 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 17:54:37.087400 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e8626cdf-0caf-4bed-b961-6b1b49acacac could not be found. Jul 14 17:54:37.087400 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 17:54:37.087400 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-6b084dbc-8102-4715-a7ec-5277cc6bb903 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] Returning 404 to user: Volume e8626cdf-0caf-4bed-b961-6b1b49acacac could not be found. {{(pid=129470) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 17:54:37.087400 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-6b084dbc-8102-4715-a7ec-5277cc6bb903 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/e8626cdf-0caf-4bed-b961-6b1b49acacac" status: 404 len: 109 microversion: 2.1 time: 0.048064 Jul 14 17:54:37.087400 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 152/379] 10.222.0.64 () {58 vars in 1244 bytes} [Thu Jul 14 17:54:37 2022] GET /compute/v2.1/os-volumes/e8626cdf-0caf-4bed-b961-6b1b49acacac => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 17:54:37.100734 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-2cbf1caf-6462-4875-b966-a742069d237c tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] Calling method '.version_select at 0x7f13802acaf0>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:37.145206 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.wsgi [None req-2cbf1caf-6462-4875-b966-a742069d237c tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] HTTP exception thrown: Volume e8626cdf-0caf-4bed-b961-6b1b49acacac could not be found. Jul 14 17:54:37.147506 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-2cbf1caf-6462-4875-b966-a742069d237c tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] Request method failure captured: Jul 14 17:54:37.147506 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: request: DELETE /compute/v2.1/os-volumes/e8626cdf-0caf-4bed-b961-6b1b49acacac HTTP/1.1 Jul 14 17:54:37.147506 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept: application/json Jul 14 17:54:37.147506 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept-Encoding: identity Jul 14 17:54:37.147506 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Connection: close Jul 14 17:54:37.147506 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Length: 0 Jul 14 17:54:37.147506 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Type: application/json Jul 14 17:54:37.147506 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Host: 10.222.0.64 Jul 14 17:54:37.147506 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Openstack-System-Scope: None Jul 14 17:54:37.147506 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: User-Agent: python-urllib3/1.26.9 Jul 14 17:54:37.147506 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Auth-Token: gAAAAABi0FhOgAWO9k7lc2CrqMJIXRhdBn9cNxatfzPu5RGtwfgoO5aL0ObXc_UAJTUtaEjurePOvTrAQbO2TkY78c_LhRMVp1aeqMFjnPZ7rb2OK58A7-5JWDuao7AmO8WeQ4GSWH04kRJg4-Je2AuMDK3hTogLUvHV5-H5M2tm5BeKzRivKHI Jul 14 17:54:37.147506 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Id: None Jul 14 17:54:37.147506 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Name: None Jul 14 17:54:37.147506 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Identity-Status: Confirmed Jul 14 17:54:37.147506 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Is-Admin-Project: True Jul 14 17:54:37.147506 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Id: default Jul 14 17:54:37.147506 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Name: Default Jul 14 17:54:37.147506 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Id: 8b1103c5cdec41ef85f6cacbe0ec7f86 Jul 14 17:54:37.147506 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-534730919 Jul 14 17:54:37.147506 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Role: reader,member Jul 14 17:54:37.147506 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Roles: reader,member Jul 14 17:54:37.149053 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8b1103c5cdec41ef85f6cacbe0ec7f86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/8b1103c5cdec41ef85f6cacbe0ec7f86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8b1103c5cdec41ef85f6cacbe0ec7f86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_8b1103c5cdec41ef85f6cacbe0ec7f86", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 17:54:37.149053 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant: tempest-VolumesSnapshotsTestJSON-534730919 Jul 14 17:54:37.149053 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Id: 8b1103c5cdec41ef85f6cacbe0ec7f86 Jul 14 17:54:37.149053 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-534730919 Jul 14 17:54:37.149053 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User: tempest-VolumesSnapshotsTestJSON-534730919-project Jul 14 17:54:37.149053 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Id: default Jul 14 17:54:37.149053 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Name: Default Jul 14 17:54:37.149053 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Id: 1b9b8efaf17643e5b27f295e982162a5 Jul 14 17:54:37.149053 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Name: tempest-VolumesSnapshotsTestJSON-534730919-project Jul 14 17:54:37.149053 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: method: Jul 14 17:54:37.149053 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: exception: Volume e8626cdf-0caf-4bed-b961-6b1b49acacac could not be found. Jul 14 17:54:37.149053 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: action_args: {'id': 'e8626cdf-0caf-4bed-b961-6b1b49acacac'} Jul 14 17:54:37.149053 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 17:54:37.149913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:54:37.149913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 17:54:37.149913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 17:54:37.149913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 17:54:37.149913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 17:54:37.149913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 17:54:37.149913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 17:54:37.149913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 17:54:37.149913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 17:54:37.149913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 17:54:37.149913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 17:54:37.149913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 17:54:37.149913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 17:54:37.149913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 17:54:37.149913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 17:54:37.149913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e8626cdf-0caf-4bed-b961-6b1b49acacac could not be found. (HTTP 404) (Request-ID: req-1de19373-2a2a-4d4a-96b1-0adeedf6476b) Jul 14 17:54:37.149913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:54:37.149913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:54:37.149913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:54:37.152626 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:54:37.152626 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 17:54:37.152626 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 17:54:37.152626 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 17:54:37.152626 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 17:54:37.152626 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 17:54:37.152626 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 17:54:37.152626 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 17:54:37.152626 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 17:54:37.152626 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 17:54:37.152626 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 17:54:37.152626 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 17:54:37.152626 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 17:54:37.152626 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 17:54:37.152626 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 17:54:37.152626 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 17:54:37.152626 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 17:54:37.152626 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 17:54:37.152626 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 17:54:37.153913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 17:54:37.153913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 17:54:37.153913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 17:54:37.153913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 17:54:37.153913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e8626cdf-0caf-4bed-b961-6b1b49acacac could not be found. Jul 14 17:54:37.153913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:54:37.153913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:54:37.153913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:54:37.153913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:54:37.153913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:54:37.153913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:54:37.153913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 17:54:37.153913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 17:54:37.153913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 17:54:37.153913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 17:54:37.153913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 17:54:37.153913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 17:54:37.153913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 17:54:37.153913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 17:54:37.155204 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e8626cdf-0caf-4bed-b961-6b1b49acacac could not be found. Jul 14 17:54:37.155204 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:54:37.155204 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:54:37.155204 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:54:37.155204 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:54:37.155204 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:54:37.155204 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:54:37.155204 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 17:54:37.155204 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 17:54:37.155204 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e8626cdf-0caf-4bed-b961-6b1b49acacac could not be found. Jul 14 17:54:37.155204 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:54:37.155204 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-2cbf1caf-6462-4875-b966-a742069d237c tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] Returning 404 to user: Volume e8626cdf-0caf-4bed-b961-6b1b49acacac could not be found. {{(pid=129471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 17:54:37.155204 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-2cbf1caf-6462-4875-b966-a742069d237c tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/e8626cdf-0caf-4bed-b961-6b1b49acacac" status: 404 len: 109 microversion: 2.1 time: 0.057018 Jul 14 17:54:37.155204 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 228/380] 10.222.0.64 () {58 vars in 1247 bytes} [Thu Jul 14 17:54:37 2022] DELETE /compute/v2.1/os-volumes/e8626cdf-0caf-4bed-b961-6b1b49acacac => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 17:54:37.160899 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-842b3007-9a0f-42fe-8286-70d06a7122f1 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] Calling method '.version_select at 0x7f1380083550>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:37.195316 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.wsgi [None req-842b3007-9a0f-42fe-8286-70d06a7122f1 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] HTTP exception thrown: Volume e8626cdf-0caf-4bed-b961-6b1b49acacac could not be found. Jul 14 17:54:37.197349 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-842b3007-9a0f-42fe-8286-70d06a7122f1 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] Request method failure captured: Jul 14 17:54:37.197349 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: request: GET /compute/v2.1/os-volumes/e8626cdf-0caf-4bed-b961-6b1b49acacac HTTP/1.1 Jul 14 17:54:37.197349 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept: application/json Jul 14 17:54:37.197349 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept-Encoding: identity Jul 14 17:54:37.197349 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Connection: close Jul 14 17:54:37.197349 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Length: 0 Jul 14 17:54:37.197349 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Type: application/json Jul 14 17:54:37.197349 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Host: 10.222.0.64 Jul 14 17:54:37.197349 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Openstack-System-Scope: None Jul 14 17:54:37.197349 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: User-Agent: python-urllib3/1.26.9 Jul 14 17:54:37.197349 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Auth-Token: gAAAAABi0FhOgAWO9k7lc2CrqMJIXRhdBn9cNxatfzPu5RGtwfgoO5aL0ObXc_UAJTUtaEjurePOvTrAQbO2TkY78c_LhRMVp1aeqMFjnPZ7rb2OK58A7-5JWDuao7AmO8WeQ4GSWH04kRJg4-Je2AuMDK3hTogLUvHV5-H5M2tm5BeKzRivKHI Jul 14 17:54:37.197349 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Id: None Jul 14 17:54:37.197349 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Name: None Jul 14 17:54:37.197349 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Identity-Status: Confirmed Jul 14 17:54:37.197349 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Is-Admin-Project: True Jul 14 17:54:37.197349 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Id: default Jul 14 17:54:37.197349 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Name: Default Jul 14 17:54:37.197349 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Id: 8b1103c5cdec41ef85f6cacbe0ec7f86 Jul 14 17:54:37.197349 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-534730919 Jul 14 17:54:37.197349 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Role: reader,member Jul 14 17:54:37.197349 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Roles: reader,member Jul 14 17:54:37.199057 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8b1103c5cdec41ef85f6cacbe0ec7f86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/8b1103c5cdec41ef85f6cacbe0ec7f86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8b1103c5cdec41ef85f6cacbe0ec7f86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_8b1103c5cdec41ef85f6cacbe0ec7f86", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 17:54:37.199057 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant: tempest-VolumesSnapshotsTestJSON-534730919 Jul 14 17:54:37.199057 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Id: 8b1103c5cdec41ef85f6cacbe0ec7f86 Jul 14 17:54:37.199057 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-534730919 Jul 14 17:54:37.199057 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User: tempest-VolumesSnapshotsTestJSON-534730919-project Jul 14 17:54:37.199057 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Id: default Jul 14 17:54:37.199057 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Name: Default Jul 14 17:54:37.199057 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Id: 1b9b8efaf17643e5b27f295e982162a5 Jul 14 17:54:37.199057 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Name: tempest-VolumesSnapshotsTestJSON-534730919-project Jul 14 17:54:37.199057 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: method: Jul 14 17:54:37.199057 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: exception: Volume e8626cdf-0caf-4bed-b961-6b1b49acacac could not be found. Jul 14 17:54:37.199057 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: action_args: {'id': 'e8626cdf-0caf-4bed-b961-6b1b49acacac'} Jul 14 17:54:37.199057 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 17:54:37.199966 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:54:37.199966 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 17:54:37.199966 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 17:54:37.199966 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 17:54:37.199966 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 17:54:37.199966 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 17:54:37.199966 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 17:54:37.199966 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 17:54:37.199966 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 17:54:37.199966 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 17:54:37.199966 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 17:54:37.199966 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 17:54:37.199966 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 17:54:37.199966 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 17:54:37.199966 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 17:54:37.199966 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e8626cdf-0caf-4bed-b961-6b1b49acacac could not be found. (HTTP 404) (Request-ID: req-e1ef74d9-ca90-425e-895f-d11f9e53065b) Jul 14 17:54:37.199966 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 17:54:37.199966 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:54:37.199966 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 17:54:37.201115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:54:37.201115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 17:54:37.201115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 17:54:37.201115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 17:54:37.201115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 17:54:37.201115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 17:54:37.201115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 17:54:37.201115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 17:54:37.201115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 17:54:37.201115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 17:54:37.201115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 17:54:37.201115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 17:54:37.201115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 17:54:37.201115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 17:54:37.201115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 17:54:37.201115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 17:54:37.201115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 17:54:37.201115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 17:54:37.201115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 17:54:37.202201 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 17:54:37.202201 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 17:54:37.202201 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 17:54:37.202201 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 17:54:37.202201 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e8626cdf-0caf-4bed-b961-6b1b49acacac could not be found. Jul 14 17:54:37.202201 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 17:54:37.202201 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:54:37.202201 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 17:54:37.202201 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:54:37.202201 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:54:37.202201 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:54:37.202201 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 17:54:37.202201 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 17:54:37.202201 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 17:54:37.202201 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 17:54:37.202201 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 17:54:37.202201 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 17:54:37.202201 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 17:54:37.202201 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 17:54:37.203872 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e8626cdf-0caf-4bed-b961-6b1b49acacac could not be found. Jul 14 17:54:37.203872 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 17:54:37.203872 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:54:37.203872 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 17:54:37.203872 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:54:37.203872 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:54:37.203872 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:54:37.203872 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 17:54:37.203872 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 17:54:37.203872 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e8626cdf-0caf-4bed-b961-6b1b49acacac could not be found. Jul 14 17:54:37.203872 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 17:54:37.203872 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-842b3007-9a0f-42fe-8286-70d06a7122f1 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] Returning 404 to user: Volume e8626cdf-0caf-4bed-b961-6b1b49acacac could not be found. {{(pid=129470) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 17:54:37.203872 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-842b3007-9a0f-42fe-8286-70d06a7122f1 tempest-VolumesSnapshotsTestJSON-534730919 tempest-VolumesSnapshotsTestJSON-534730919-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/e8626cdf-0caf-4bed-b961-6b1b49acacac" status: 404 len: 109 microversion: 2.1 time: 0.043992 Jul 14 17:54:37.203872 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 153/381] 10.222.0.64 () {58 vars in 1244 bytes} [Thu Jul 14 17:54:37 2022] GET /compute/v2.1/os-volumes/e8626cdf-0caf-4bed-b961-6b1b49acacac => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 17:54:37.314588 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-76e2dc5d-3e1f-4deb-b746-816dfa2fe339 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:37.315238 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-76e2dc5d-3e1f-4deb-b746-816dfa2fe339 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:37.323490 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-76e2dc5d-3e1f-4deb-b746-816dfa2fe339 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:37.323980 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-76e2dc5d-3e1f-4deb-b746-816dfa2fe339 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:37.324768 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-76e2dc5d-3e1f-4deb-b746-816dfa2fe339 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:37.325203 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-76e2dc5d-3e1f-4deb-b746-816dfa2fe339 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:37.487115 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-76e2dc5d-3e1f-4deb-b746-816dfa2fe339 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:37.495634 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-76e2dc5d-3e1f-4deb-b746-816dfa2fe339 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.185018 Jul 14 17:54:37.496830 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 229/382] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:37 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:37.897972 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-d9f4d2e3-6de6-4052-8748-e998c2b163b5 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:37.898612 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-d9f4d2e3-6de6-4052-8748-e998c2b163b5 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: c69458a5-5cab-40fc-bf93-332204bebcd5] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:37.905476 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d9f4d2e3-6de6-4052-8748-e998c2b163b5 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:37.906230 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d9f4d2e3-6de6-4052-8748-e998c2b163b5 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:37.907064 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d9f4d2e3-6de6-4052-8748-e998c2b163b5 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:37.908079 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d9f4d2e3-6de6-4052-8748-e998c2b163b5 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:38.171271 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-d9f4d2e3-6de6-4052-8748-e998c2b163b5 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:38.192804 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-d9f4d2e3-6de6-4052-8748-e998c2b163b5 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5" status: 200 len: 1313 microversion: 2.1 time: 0.299340 Jul 14 17:54:38.211871 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 154/383] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:37 2022] GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5 => generated 1313 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:38.516475 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-31b36942-2be0-40f6-a648-634658083148 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:38.516475 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-31b36942-2be0-40f6-a648-634658083148 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:38.525161 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-31b36942-2be0-40f6-a648-634658083148 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:38.525618 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-31b36942-2be0-40f6-a648-634658083148 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:38.526510 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-31b36942-2be0-40f6-a648-634658083148 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:38.526983 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-31b36942-2be0-40f6-a648-634658083148 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:38.721570 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-31b36942-2be0-40f6-a648-634658083148 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:38.729692 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-31b36942-2be0-40f6-a648-634658083148 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.218826 Jul 14 17:54:38.730581 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 230/384] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:38 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:39.213977 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-af09eac8-8f13-4bd0-84a3-5f8b1217862e tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:39.215380 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-af09eac8-8f13-4bd0-84a3-5f8b1217862e tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: c69458a5-5cab-40fc-bf93-332204bebcd5] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:39.224550 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-af09eac8-8f13-4bd0-84a3-5f8b1217862e tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:39.225025 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-af09eac8-8f13-4bd0-84a3-5f8b1217862e tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:39.225794 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-af09eac8-8f13-4bd0-84a3-5f8b1217862e tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:39.226206 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-af09eac8-8f13-4bd0-84a3-5f8b1217862e tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:39.231507 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=100 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:54:39.382637 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-af09eac8-8f13-4bd0-84a3-5f8b1217862e tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:39.390359 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-af09eac8-8f13-4bd0-84a3-5f8b1217862e tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5" status: 200 len: 1496 microversion: 2.1 time: 0.180538 Jul 14 17:54:39.391178 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 155/385] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:39 2022] GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5 => generated 1496 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:39.746579 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-cc12803e-6d77-470f-b25c-1e8bf46a5851 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:39.747185 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-cc12803e-6d77-470f-b25c-1e8bf46a5851 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:39.754488 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-cc12803e-6d77-470f-b25c-1e8bf46a5851 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:39.754941 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-cc12803e-6d77-470f-b25c-1e8bf46a5851 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:39.755714 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-cc12803e-6d77-470f-b25c-1e8bf46a5851 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:39.756183 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-cc12803e-6d77-470f-b25c-1e8bf46a5851 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:39.929572 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-cc12803e-6d77-470f-b25c-1e8bf46a5851 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:39.938270 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-cc12803e-6d77-470f-b25c-1e8bf46a5851 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.195276 Jul 14 17:54:39.939109 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 231/386] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:39 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:40.068573 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-270502bf-0b81-4326-8264-8d165e059c58 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:40.069368 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-270502bf-0b81-4326-8264-8d165e059c58 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: c69458a5-5cab-40fc-bf93-332204bebcd5] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:40.076224 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-270502bf-0b81-4326-8264-8d165e059c58 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:40.077172 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-270502bf-0b81-4326-8264-8d165e059c58 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:40.078116 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-270502bf-0b81-4326-8264-8d165e059c58 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:40.078553 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-270502bf-0b81-4326-8264-8d165e059c58 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:40.114002 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-270502bf-0b81-4326-8264-8d165e059c58 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: c69458a5-5cab-40fc-bf93-332204bebcd5] Going to try to terminate instance {{(pid=129470) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 17:54:40.251539 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-270502bf-0b81-4326-8264-8d165e059c58 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "DELETE /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5" status: 204 len: 0 microversion: 2.1 time: 0.185388 Jul 14 17:54:40.253195 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 156/387] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Jul 14 17:54:40 2022] DELETE /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 17:54:40.262555 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-d0395113-da8e-4de5-9e50-e06a0fda943e tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:40.263287 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-d0395113-da8e-4de5-9e50-e06a0fda943e tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: c69458a5-5cab-40fc-bf93-332204bebcd5] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:40.282780 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d0395113-da8e-4de5-9e50-e06a0fda943e tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:40.283551 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d0395113-da8e-4de5-9e50-e06a0fda943e tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:40.284744 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d0395113-da8e-4de5-9e50-e06a0fda943e tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:40.285533 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d0395113-da8e-4de5-9e50-e06a0fda943e tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:40.444820 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-d0395113-da8e-4de5-9e50-e06a0fda943e tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:40.456283 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-d0395113-da8e-4de5-9e50-e06a0fda943e tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5" status: 200 len: 1502 microversion: 2.1 time: 0.197643 Jul 14 17:54:40.463324 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 232/388] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:40 2022] GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5 => generated 1502 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:40.957864 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-59c2f328-3a6d-44f2-864a-eb4232f6bef5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:40.958701 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-59c2f328-3a6d-44f2-864a-eb4232f6bef5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:40.966897 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-59c2f328-3a6d-44f2-864a-eb4232f6bef5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:40.967359 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-59c2f328-3a6d-44f2-864a-eb4232f6bef5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:40.968178 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-59c2f328-3a6d-44f2-864a-eb4232f6bef5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:40.968621 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-59c2f328-3a6d-44f2-864a-eb4232f6bef5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:41.196683 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-59c2f328-3a6d-44f2-864a-eb4232f6bef5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:41.204764 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-59c2f328-3a6d-44f2-864a-eb4232f6bef5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.251724 Jul 14 17:54:41.205486 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 157/389] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:40 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:41.474653 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-c94fedae-eae2-439f-816b-8e760731eaac tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:41.475352 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-c94fedae-eae2-439f-816b-8e760731eaac tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: c69458a5-5cab-40fc-bf93-332204bebcd5] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:41.484101 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c94fedae-eae2-439f-816b-8e760731eaac tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:41.484840 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c94fedae-eae2-439f-816b-8e760731eaac tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:41.485835 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c94fedae-eae2-439f-816b-8e760731eaac tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:41.486555 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c94fedae-eae2-439f-816b-8e760731eaac tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:41.711695 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-c94fedae-eae2-439f-816b-8e760731eaac tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:41.720251 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-c94fedae-eae2-439f-816b-8e760731eaac tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5" status: 200 len: 1502 microversion: 2.1 time: 0.249943 Jul 14 17:54:41.723907 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 233/390] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:41 2022] GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5 => generated 1502 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:42.225824 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-2e053769-96fb-41df-9b68-7dd127dac892 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:42.226664 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-2e053769-96fb-41df-9b68-7dd127dac892 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:42.234713 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2e053769-96fb-41df-9b68-7dd127dac892 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:42.235253 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2e053769-96fb-41df-9b68-7dd127dac892 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:42.236172 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2e053769-96fb-41df-9b68-7dd127dac892 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:42.236684 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2e053769-96fb-41df-9b68-7dd127dac892 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:42.403136 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-2e053769-96fb-41df-9b68-7dd127dac892 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:42.411004 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-2e053769-96fb-41df-9b68-7dd127dac892 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.193170 Jul 14 17:54:42.412047 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 158/391] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:42 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:42.740235 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-a845600c-f25d-40cc-b7f1-0f07ba3dee7b tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:42.740866 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-a845600c-f25d-40cc-b7f1-0f07ba3dee7b tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: c69458a5-5cab-40fc-bf93-332204bebcd5] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:42.748265 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a845600c-f25d-40cc-b7f1-0f07ba3dee7b tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:42.749098 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a845600c-f25d-40cc-b7f1-0f07ba3dee7b tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:42.749906 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a845600c-f25d-40cc-b7f1-0f07ba3dee7b tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:42.750651 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a845600c-f25d-40cc-b7f1-0f07ba3dee7b tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:42.884444 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-a845600c-f25d-40cc-b7f1-0f07ba3dee7b tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:42.896114 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-a845600c-f25d-40cc-b7f1-0f07ba3dee7b tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5" status: 200 len: 1502 microversion: 2.1 time: 0.161741 Jul 14 17:54:42.896771 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 234/392] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:42 2022] GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5 => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:43.429915 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-33b477f2-e1f8-4d6a-804b-811120b32d2c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:43.431212 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-33b477f2-e1f8-4d6a-804b-811120b32d2c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:43.438473 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-33b477f2-e1f8-4d6a-804b-811120b32d2c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:43.438986 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-33b477f2-e1f8-4d6a-804b-811120b32d2c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:43.439994 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-33b477f2-e1f8-4d6a-804b-811120b32d2c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:43.440436 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-33b477f2-e1f8-4d6a-804b-811120b32d2c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:43.612744 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-33b477f2-e1f8-4d6a-804b-811120b32d2c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:43.625839 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-33b477f2-e1f8-4d6a-804b-811120b32d2c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1521 microversion: 2.1 time: 0.201039 Jul 14 17:54:43.627961 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 159/393] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:43 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:43.919435 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-4c87b37e-1bcd-467d-91ce-2f52d193a95a tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:43.929802 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-4c87b37e-1bcd-467d-91ce-2f52d193a95a tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: c69458a5-5cab-40fc-bf93-332204bebcd5] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:43.952702 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4c87b37e-1bcd-467d-91ce-2f52d193a95a tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:43.953489 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4c87b37e-1bcd-467d-91ce-2f52d193a95a tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:43.954859 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4c87b37e-1bcd-467d-91ce-2f52d193a95a tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:43.955630 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4c87b37e-1bcd-467d-91ce-2f52d193a95a tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:44.185451 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-f3361590-6020-4a13-9531-045a6f52e4ef req-6c79aba3-41c1-473c-ba0b-2e2be56937c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c69458a5-5cab-40fc-bf93-332204bebcd5", "name": "network-vif-deleted", "tag": "79249223-593f-4a5b-8226-3f41d2e34e6a"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:54:44.194340 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-f3361590-6020-4a13-9531-045a6f52e4ef req-6c79aba3-41c1-473c-ba0b-2e2be56937c0 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:44.195186 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-f3361590-6020-4a13-9531-045a6f52e4ef req-6c79aba3-41c1-473c-ba0b-2e2be56937c0 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:44.207424 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-f3361590-6020-4a13-9531-045a6f52e4ef req-6c79aba3-41c1-473c-ba0b-2e2be56937c0 service nova] Creating event network-vif-deleted:79249223-593f-4a5b-8226-3f41d2e34e6a for instance c69458a5-5cab-40fc-bf93-332204bebcd5 on hv-cinder-84989 Jul 14 17:54:44.212881 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-f3361590-6020-4a13-9531-045a6f52e4ef req-6c79aba3-41c1-473c-ba0b-2e2be56937c0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031268 Jul 14 17:54:44.213480 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 160/394] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 17:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 17:54:44.255267 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-4c87b37e-1bcd-467d-91ce-2f52d193a95a tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:44.278819 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-4c87b37e-1bcd-467d-91ce-2f52d193a95a tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5" status: 200 len: 1502 microversion: 2.1 time: 0.367638 Jul 14 17:54:44.280706 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 235/395] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:43 2022] GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5 => generated 1502 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:44.643591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-615a78b5-d7e9-4407-bfa6-7ee6a22deb7e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:44.645786 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-615a78b5-d7e9-4407-bfa6-7ee6a22deb7e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:44.653724 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-615a78b5-d7e9-4407-bfa6-7ee6a22deb7e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:44.654662 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-615a78b5-d7e9-4407-bfa6-7ee6a22deb7e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:44.655721 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-615a78b5-d7e9-4407-bfa6-7ee6a22deb7e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:44.656438 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-615a78b5-d7e9-4407-bfa6-7ee6a22deb7e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:44.927034 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-615a78b5-d7e9-4407-bfa6-7ee6a22deb7e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:44.940668 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-615a78b5-d7e9-4407-bfa6-7ee6a22deb7e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1501 microversion: 2.1 time: 0.300980 Jul 14 17:54:44.943409 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 161/396] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:44 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1501 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:44.961764 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-e8ea09c4-eac1-40d6-accd-f406f7266e05 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:44.963242 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-e8ea09c4-eac1-40d6-accd-f406f7266e05 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:44.972752 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e8ea09c4-eac1-40d6-accd-f406f7266e05 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:44.973818 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e8ea09c4-eac1-40d6-accd-f406f7266e05 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:44.975683 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e8ea09c4-eac1-40d6-accd-f406f7266e05 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:44.976315 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e8ea09c4-eac1-40d6-accd-f406f7266e05 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:45.253453 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-e8ea09c4-eac1-40d6-accd-f406f7266e05 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:45.261656 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-e8ea09c4-eac1-40d6-accd-f406f7266e05 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1515 microversion: 2.1 time: 0.305271 Jul 14 17:54:45.262958 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 236/397] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:44 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1515 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:45.297829 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-f5262893-9492-4cde-8f1c-c7c7ebeafdd0 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:45.298887 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-f5262893-9492-4cde-8f1c-c7c7ebeafdd0 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: c69458a5-5cab-40fc-bf93-332204bebcd5] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:45.310125 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f5262893-9492-4cde-8f1c-c7c7ebeafdd0 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:45.310910 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f5262893-9492-4cde-8f1c-c7c7ebeafdd0 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:45.312554 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f5262893-9492-4cde-8f1c-c7c7ebeafdd0 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:45.314212 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f5262893-9492-4cde-8f1c-c7c7ebeafdd0 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:45.334312 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.wsgi [None req-f5262893-9492-4cde-8f1c-c7c7ebeafdd0 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] HTTP exception thrown: Instance c69458a5-5cab-40fc-bf93-332204bebcd5 could not be found. Jul 14 17:54:45.336633 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-f5262893-9492-4cde-8f1c-c7c7ebeafdd0 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Request method failure captured: Jul 14 17:54:45.336633 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: request: GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5 HTTP/1.1 Jul 14 17:54:45.336633 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept: application/json Jul 14 17:54:45.336633 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept-Encoding: identity Jul 14 17:54:45.336633 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Connection: close Jul 14 17:54:45.336633 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Length: 0 Jul 14 17:54:45.336633 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Type: application/json Jul 14 17:54:45.336633 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Host: 10.222.0.64 Jul 14 17:54:45.336633 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Openstack-System-Scope: None Jul 14 17:54:45.336633 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: User-Agent: python-urllib3/1.26.9 Jul 14 17:54:45.336633 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Auth-Token: gAAAAABi0FhFWdiR9VgINOMVfAEZOTZVw5pE3hcY5rB5GzhEXbkc-PodyEJVZk7atEovJT-QgJSV4ISQmwdW_XAcaVrLslV-O7OTkc26F5sbpPPJ9Hm5l6Cvv33pqcSuwhVIaIJkMGKmsjUZ9pziRLZjIPjudLvY9CvpHnXtxHdlERVSi_TPcGo Jul 14 17:54:45.336633 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Id: None Jul 14 17:54:45.336633 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Name: None Jul 14 17:54:45.336633 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Identity-Status: Confirmed Jul 14 17:54:45.336633 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Is-Admin-Project: True Jul 14 17:54:45.336633 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Id: default Jul 14 17:54:45.336633 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Name: Default Jul 14 17:54:45.336633 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Id: a84353cfe41640e3b13d561b615e1142 Jul 14 17:54:45.336633 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Name: tempest-VolumesActionsTest-205937016 Jul 14 17:54:45.336633 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Role: reader,member Jul 14 17:54:45.336633 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Roles: reader,member Jul 14 17:54:45.338519 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a84353cfe41640e3b13d561b615e1142"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a84353cfe41640e3b13d561b615e1142"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a84353cfe41640e3b13d561b615e1142"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a84353cfe41640e3b13d561b615e1142", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 17:54:45.338519 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant: tempest-VolumesActionsTest-205937016 Jul 14 17:54:45.338519 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Id: a84353cfe41640e3b13d561b615e1142 Jul 14 17:54:45.338519 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Name: tempest-VolumesActionsTest-205937016 Jul 14 17:54:45.338519 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User: tempest-VolumesActionsTest-205937016-project Jul 14 17:54:45.338519 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Id: default Jul 14 17:54:45.338519 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Name: Default Jul 14 17:54:45.338519 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Id: d3b3a526943646dcba7bb1806601696b Jul 14 17:54:45.338519 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Name: tempest-VolumesActionsTest-205937016-project Jul 14 17:54:45.338519 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: method: > Jul 14 17:54:45.338519 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: exception: Instance c69458a5-5cab-40fc-bf93-332204bebcd5 could not be found. Jul 14 17:54:45.338519 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: action_args: {'id': 'c69458a5-5cab-40fc-bf93-332204bebcd5'} Jul 14 17:54:45.339550 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 17:54:45.339550 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:54:45.339550 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 17:54:45.339550 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 17:54:45.339550 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 17:54:45.339550 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 17:54:45.339550 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 17:54:45.339550 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 17:54:45.339550 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 17:54:45.339550 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 17:54:45.339550 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c69458a5-5cab-40fc-bf93-332204bebcd5 could not be found. Jul 14 17:54:45.339550 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 17:54:45.339550 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:54:45.339550 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 17:54:45.339550 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:54:45.339550 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:54:45.339550 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:54:45.339550 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 17:54:45.339550 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 17:54:45.339550 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 17:54:45.353697 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 17:54:45.353697 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 17:54:45.353697 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 17:54:45.353697 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 17:54:45.353697 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 17:54:45.353697 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 17:54:45.353697 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 17:54:45.353697 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c69458a5-5cab-40fc-bf93-332204bebcd5 could not be found. Jul 14 17:54:45.353697 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 17:54:45.353697 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:54:45.353697 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 17:54:45.353697 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:54:45.353697 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:54:45.353697 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:54:45.353697 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 17:54:45.353697 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 17:54:45.353697 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c69458a5-5cab-40fc-bf93-332204bebcd5 could not be found. Jul 14 17:54:45.353697 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 17:54:45.356237 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-f5262893-9492-4cde-8f1c-c7c7ebeafdd0 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Returning 404 to user: Instance c69458a5-5cab-40fc-bf93-332204bebcd5 could not be found. {{(pid=129470) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 17:54:45.356237 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-f5262893-9492-4cde-8f1c-c7c7ebeafdd0 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5" status: 404 len: 111 microversion: 2.1 time: 0.046519 Jul 14 17:54:45.356237 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 162/398] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:45 2022] GET /compute/v2.1/servers/c69458a5-5cab-40fc-bf93-332204bebcd5 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 17:54:45.504996 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-4d0fe5f7-1698-49fd-b5a4-59defd83d2a8 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-52732052", "imageRef": "cf1f5d8c-9e49-4272-8e19-8e3c587056e1", "flavorRef": "452", "networks": [{"uuid": "efaa634e-c527-4548-841a-e8d87f1670aa"}]}} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:54:45.649160 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.network.neutron [None req-4d0fe5f7-1698-49fd-b5a4-59defd83d2a8 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] validate_networks() for [('efaa634e-c527-4548-841a-e8d87f1670aa', None, None, None, None, None)] {{(pid=129471) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 17:54:46.369056 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-4d0fe5f7-1698-49fd-b5a4-59defd83d2a8 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Flavor limits 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 17:54:46.370164 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-4d0fe5f7-1698-49fd-b5a4-59defd83d2a8 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Image limits 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 17:54:46.370644 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-4d0fe5f7-1698-49fd-b5a4-59defd83d2a8 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Flavor pref 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 17:54:46.371223 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-4d0fe5f7-1698-49fd-b5a4-59defd83d2a8 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Image pref 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 17:54:46.372123 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-4d0fe5f7-1698-49fd-b5a4-59defd83d2a8 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 17:54:46.381964 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4d0fe5f7-1698-49fd-b5a4-59defd83d2a8 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:46.382861 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4d0fe5f7-1698-49fd-b5a4-59defd83d2a8 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:46.383449 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4d0fe5f7-1698-49fd-b5a4-59defd83d2a8 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:46.384073 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4d0fe5f7-1698-49fd-b5a4-59defd83d2a8 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:46.403544 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.quota [None req-4d0fe5f7-1698-49fd-b5a4-59defd83d2a8 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Getting quotas for project a84353cfe41640e3b13d561b615e1142. Resources: {'ram', 'cores', 'instances'} {{(pid=129471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 17:54:46.408475 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.quota [None req-4d0fe5f7-1698-49fd-b5a4-59defd83d2a8 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Getting quotas for user d3b3a526943646dcba7bb1806601696b and project a84353cfe41640e3b13d561b615e1142. Resources: {'ram', 'cores', 'instances'} {{(pid=129471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 17:54:46.424090 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-4d0fe5f7-1698-49fd-b5a4-59defd83d2a8 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Going to run 1 instances... {{(pid=129471) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 17:54:46.426748 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-4d0fe5f7-1698-49fd-b5a4-59defd83d2a8 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: a2ceaa41-4d41-41d6-a38b-caf6c587391b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf1f5d8c-9e49-4272-8e19-8e3c587056e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 17:54:46.490131 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-4d0fe5f7-1698-49fd-b5a4-59defd83d2a8 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.989126 Jul 14 17:54:46.490792 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 237/399] 10.222.0.64 () {60 vars in 1146 bytes} [Thu Jul 14 17:54:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 17:54:46.502495 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-afb42624-a5f6-4ea6-8c0c-eb025dfd865a tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:46.506597 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-afb42624-a5f6-4ea6-8c0c-eb025dfd865a tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: a2ceaa41-4d41-41d6-a38b-caf6c587391b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:46.610135 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-afb42624-a5f6-4ea6-8c0c-eb025dfd865a tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:46.622468 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-afb42624-a5f6-4ea6-8c0c-eb025dfd865a tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b" status: 200 len: 1212 microversion: 2.1 time: 0.125131 Jul 14 17:54:46.624138 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 163/400] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:46 2022] GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b => generated 1212 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:47.640908 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-487888c0-0e60-49f3-869a-412774a235a3 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:47.641536 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-487888c0-0e60-49f3-869a-412774a235a3 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: a2ceaa41-4d41-41d6-a38b-caf6c587391b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:47.649241 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-487888c0-0e60-49f3-869a-412774a235a3 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:47.649698 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-487888c0-0e60-49f3-869a-412774a235a3 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:47.651120 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-487888c0-0e60-49f3-869a-412774a235a3 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:47.651698 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-487888c0-0e60-49f3-869a-412774a235a3 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:47.989206 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-487888c0-0e60-49f3-869a-412774a235a3 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:47.997790 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-487888c0-0e60-49f3-869a-412774a235a3 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b" status: 200 len: 1216 microversion: 2.1 time: 0.360782 Jul 14 17:54:48.008235 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 238/401] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:47 2022] GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b => generated 1216 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:49.016607 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-77d0c434-adda-41db-abf9-5ee6a40ff137 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:49.019418 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-77d0c434-adda-41db-abf9-5ee6a40ff137 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: a2ceaa41-4d41-41d6-a38b-caf6c587391b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:49.030017 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-77d0c434-adda-41db-abf9-5ee6a40ff137 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:49.030780 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-77d0c434-adda-41db-abf9-5ee6a40ff137 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:49.031802 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-77d0c434-adda-41db-abf9-5ee6a40ff137 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:49.032672 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-77d0c434-adda-41db-abf9-5ee6a40ff137 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:49.183010 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-77d0c434-adda-41db-abf9-5ee6a40ff137 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:49.197023 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-77d0c434-adda-41db-abf9-5ee6a40ff137 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b" status: 200 len: 1208 microversion: 2.1 time: 0.185933 Jul 14 17:54:49.198498 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 164/402] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:49 2022] GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b => generated 1208 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:54:50.216939 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-ff10f3f8-fc17-4d6a-98ae-98b3bb5920af tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:50.218507 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-ff10f3f8-fc17-4d6a-98ae-98b3bb5920af tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: a2ceaa41-4d41-41d6-a38b-caf6c587391b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:50.235437 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ff10f3f8-fc17-4d6a-98ae-98b3bb5920af tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:50.236201 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ff10f3f8-fc17-4d6a-98ae-98b3bb5920af tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:50.237287 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ff10f3f8-fc17-4d6a-98ae-98b3bb5920af tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:50.237948 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ff10f3f8-fc17-4d6a-98ae-98b3bb5920af tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:50.385739 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-ff10f3f8-fc17-4d6a-98ae-98b3bb5920af tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:50.417878 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-ff10f3f8-fc17-4d6a-98ae-98b3bb5920af tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b" status: 200 len: 1272 microversion: 2.1 time: 0.191711 Jul 14 17:54:50.425363 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 239/403] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:50 2022] GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b => generated 1272 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:51.438895 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-7cb00f27-2222-4803-97fe-8be8de0fa90b tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:51.440920 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-7cb00f27-2222-4803-97fe-8be8de0fa90b tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: a2ceaa41-4d41-41d6-a38b-caf6c587391b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:51.453712 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7cb00f27-2222-4803-97fe-8be8de0fa90b tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:51.454291 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7cb00f27-2222-4803-97fe-8be8de0fa90b tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:51.455336 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7cb00f27-2222-4803-97fe-8be8de0fa90b tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:51.456293 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7cb00f27-2222-4803-97fe-8be8de0fa90b tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:51.524421 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-7cb00f27-2222-4803-97fe-8be8de0fa90b tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:51.538808 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-7cb00f27-2222-4803-97fe-8be8de0fa90b tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b" status: 200 len: 1270 microversion: 2.1 time: 0.105363 Jul 14 17:54:51.539824 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 165/404] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:51 2022] GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b => generated 1270 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:52.558760 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-74915ac7-f5f4-4e48-bf5c-16a4a3d34bba tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:52.560262 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-74915ac7-f5f4-4e48-bf5c-16a4a3d34bba tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: a2ceaa41-4d41-41d6-a38b-caf6c587391b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:52.567765 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-74915ac7-f5f4-4e48-bf5c-16a4a3d34bba tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:52.568316 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-74915ac7-f5f4-4e48-bf5c-16a4a3d34bba tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:52.569171 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-74915ac7-f5f4-4e48-bf5c-16a4a3d34bba tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:52.569848 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-74915ac7-f5f4-4e48-bf5c-16a4a3d34bba tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:52.572113 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-d166ee46-2c48-4ad4-966a-8ddfe8ad1048 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Action: 'create', calling method: .version_select at 0x7f13801d7e50>, body: {"keypair": {"name": "tempest-TestShelveInstance-2119343121", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCoSp6qDhXdWfPyQNj5ZB10CmXZBhl0wALoj92RWkLzT0bkGR7fh3CXoQ6lptmkKebBVINrwwTfkwtTLnnkAoHeJLi5dE3FhWy0FgIZfRco4yypUSG40Esgq/P9HbJ35ZQ=="}} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:54:52.591689 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.quota [None req-d166ee46-2c48-4ad4-966a-8ddfe8ad1048 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Getting quotas for project 96004c35e9a84f2ab6b0601e28f45627. Resources: {'key_pairs'} {{(pid=129471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 17:54:52.596321 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.quota [None req-d166ee46-2c48-4ad4-966a-8ddfe8ad1048 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Getting quotas for user 5d24ace76e3e4f10b63a53bb7482ac07 and project 96004c35e9a84f2ab6b0601e28f45627. Resources: {'key_pairs'} {{(pid=129471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 17:54:52.626606 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-d166ee46-2c48-4ad4-966a-8ddfe8ad1048 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.241109 Jul 14 17:54:52.627389 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 240/405] 10.222.0.64 () {60 vars in 1158 bytes} [Thu Jul 14 17:54:52 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:54:52.639509 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-74915ac7-f5f4-4e48-bf5c-16a4a3d34bba tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:52.648891 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-74915ac7-f5f4-4e48-bf5c-16a4a3d34bba tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b" status: 200 len: 1270 microversion: 2.1 time: 0.095254 Jul 14 17:54:52.653339 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 166/406] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:52 2022] GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b => generated 1270 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:53.667372 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-cf29d3e0-4716-49aa-8af7-638096a46334 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:53.668094 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-cf29d3e0-4716-49aa-8af7-638096a46334 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: a2ceaa41-4d41-41d6-a38b-caf6c587391b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:53.675188 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-cf29d3e0-4716-49aa-8af7-638096a46334 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:53.675700 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-cf29d3e0-4716-49aa-8af7-638096a46334 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:53.677966 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-cf29d3e0-4716-49aa-8af7-638096a46334 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:53.678493 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-cf29d3e0-4716-49aa-8af7-638096a46334 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:53.758183 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-cf29d3e0-4716-49aa-8af7-638096a46334 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:53.766999 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-cf29d3e0-4716-49aa-8af7-638096a46334 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b" status: 200 len: 1270 microversion: 2.1 time: 0.104544 Jul 14 17:54:53.767589 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 241/407] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:53 2022] GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b => generated 1270 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:54.783217 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-2df6fe0c-2da8-44a5-8b3c-424fd307c7c0 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:54.783844 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-2df6fe0c-2da8-44a5-8b3c-424fd307c7c0 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: a2ceaa41-4d41-41d6-a38b-caf6c587391b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:54.798541 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2df6fe0c-2da8-44a5-8b3c-424fd307c7c0 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:54.799069 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2df6fe0c-2da8-44a5-8b3c-424fd307c7c0 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:54.802047 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2df6fe0c-2da8-44a5-8b3c-424fd307c7c0 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:54.802504 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2df6fe0c-2da8-44a5-8b3c-424fd307c7c0 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:54.887508 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-2df6fe0c-2da8-44a5-8b3c-424fd307c7c0 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:54.895507 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-2df6fe0c-2da8-44a5-8b3c-424fd307c7c0 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b" status: 200 len: 1270 microversion: 2.1 time: 0.116205 Jul 14 17:54:54.904866 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 167/408] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:54 2022] GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b => generated 1270 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:55.915219 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-3c1d9f1b-9250-4596-b2ef-db3b607ce12d tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:55.916411 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-3c1d9f1b-9250-4596-b2ef-db3b607ce12d tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: a2ceaa41-4d41-41d6-a38b-caf6c587391b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:55.923203 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3c1d9f1b-9250-4596-b2ef-db3b607ce12d tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:55.923640 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3c1d9f1b-9250-4596-b2ef-db3b607ce12d tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:55.924620 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3c1d9f1b-9250-4596-b2ef-db3b607ce12d tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:55.925049 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3c1d9f1b-9250-4596-b2ef-db3b607ce12d tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:56.070548 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-3c1d9f1b-9250-4596-b2ef-db3b607ce12d tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:56.078275 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-3c1d9f1b-9250-4596-b2ef-db3b607ce12d tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b" status: 200 len: 1312 microversion: 2.1 time: 0.169230 Jul 14 17:54:56.078845 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 242/409] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:55 2022] GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b => generated 1312 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:56.264274 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-a553cf16-4ab8-4555-a968-1d70f97e4f7a req-54edb3a5-ac1e-4f20-a25b-507986464a6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2ceaa41-4d41-41d6-a38b-caf6c587391b", "tag": "0f68605a-9311-4160-800d-adf11c0bff9d"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:54:56.273644 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-a553cf16-4ab8-4555-a968-1d70f97e4f7a req-54edb3a5-ac1e-4f20-a25b-507986464a6b service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:56.274185 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-a553cf16-4ab8-4555-a968-1d70f97e4f7a req-54edb3a5-ac1e-4f20-a25b-507986464a6b service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:56.286602 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-a553cf16-4ab8-4555-a968-1d70f97e4f7a req-54edb3a5-ac1e-4f20-a25b-507986464a6b service nova] Creating event network-changed:0f68605a-9311-4160-800d-adf11c0bff9d for instance a2ceaa41-4d41-41d6-a38b-caf6c587391b on hv-cinder-84989 Jul 14 17:54:56.302140 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-a553cf16-4ab8-4555-a968-1d70f97e4f7a req-54edb3a5-ac1e-4f20-a25b-507986464a6b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040964 Jul 14 17:54:56.303196 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 168/410] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 17:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:54:56.555082 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-f7d701ed-1676-4550-8cdb-e7d0aeabb50e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:54:56.556460 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-f7d701ed-1676-4550-8cdb-e7d0aeabb50e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:56.562137 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell0:SELECT=2 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:54:56.564207 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f7d701ed-1676-4550-8cdb-e7d0aeabb50e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:56.565228 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f7d701ed-1676-4550-8cdb-e7d0aeabb50e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:56.566096 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f7d701ed-1676-4550-8cdb-e7d0aeabb50e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:56.566599 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f7d701ed-1676-4550-8cdb-e7d0aeabb50e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:56.597227 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.objects.instance [None req-f7d701ed-1676-4550-8cdb-e7d0aeabb50e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lazy-loading 'flavor' on Instance uuid 323310aa-bd8a-4a21-9733-b1e73763a250 {{(pid=129471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 17:54:56.715102 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-f7d701ed-1676-4550-8cdb-e7d0aeabb50e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "POST /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250/action" status: 200 len: 32 microversion: 2.1 time: 0.164725 Jul 14 17:54:56.715747 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 243/411] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Jul 14 17:54:56 2022] POST /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250/action => generated 32 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 17:54:56.722561 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell0:SELECT=2 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:54:56.728361 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-5af205e0-cf20-4e0c-b8fe-81a18c456206 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:56.729177 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-5af205e0-cf20-4e0c-b8fe-81a18c456206 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:56.736164 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5af205e0-cf20-4e0c-b8fe-81a18c456206 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:56.736702 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5af205e0-cf20-4e0c-b8fe-81a18c456206 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:56.737555 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5af205e0-cf20-4e0c-b8fe-81a18c456206 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:56.738071 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5af205e0-cf20-4e0c-b8fe-81a18c456206 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:57.014448 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-5af205e0-cf20-4e0c-b8fe-81a18c456206 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:57.027213 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-5af205e0-cf20-4e0c-b8fe-81a18c456206 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1521 microversion: 2.1 time: 0.303018 Jul 14 17:54:57.027848 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 169/412] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:56 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:57.112180 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-f2c93311-fb6d-4014-b62e-94a5dcdde8f1 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:57.116892 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-f2c93311-fb6d-4014-b62e-94a5dcdde8f1 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: a2ceaa41-4d41-41d6-a38b-caf6c587391b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:57.137434 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f2c93311-fb6d-4014-b62e-94a5dcdde8f1 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:57.137896 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f2c93311-fb6d-4014-b62e-94a5dcdde8f1 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:57.138755 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f2c93311-fb6d-4014-b62e-94a5dcdde8f1 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:57.139284 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f2c93311-fb6d-4014-b62e-94a5dcdde8f1 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:57.519462 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-f2c93311-fb6d-4014-b62e-94a5dcdde8f1 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:57.524386 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:54:57.534169 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-f2c93311-fb6d-4014-b62e-94a5dcdde8f1 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b" status: 200 len: 1312 microversion: 2.1 time: 0.441844 Jul 14 17:54:57.536981 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 244/413] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:57 2022] GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b => generated 1312 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:58.045952 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-ba17d06f-a8bb-4903-a9de-de5f819529a2 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:58.046577 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-ba17d06f-a8bb-4903-a9de-de5f819529a2 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:58.054348 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ba17d06f-a8bb-4903-a9de-de5f819529a2 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:58.054932 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ba17d06f-a8bb-4903-a9de-de5f819529a2 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:58.055971 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ba17d06f-a8bb-4903-a9de-de5f819529a2 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:58.056623 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ba17d06f-a8bb-4903-a9de-de5f819529a2 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:58.208098 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-ba17d06f-a8bb-4903-a9de-de5f819529a2 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:58.217708 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-ba17d06f-a8bb-4903-a9de-de5f819529a2 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1521 microversion: 2.1 time: 0.176321 Jul 14 17:54:58.227648 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 170/414] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:58 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:58.553899 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-9ab4a600-b12c-450b-a494-fa598866fbf8 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:58.555079 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-9ab4a600-b12c-450b-a494-fa598866fbf8 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: a2ceaa41-4d41-41d6-a38b-caf6c587391b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:58.562031 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9ab4a600-b12c-450b-a494-fa598866fbf8 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:58.562485 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9ab4a600-b12c-450b-a494-fa598866fbf8 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:58.563312 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9ab4a600-b12c-450b-a494-fa598866fbf8 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:58.563751 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9ab4a600-b12c-450b-a494-fa598866fbf8 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:58.733933 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-9ab4a600-b12c-450b-a494-fa598866fbf8 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:58.742719 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-9ab4a600-b12c-450b-a494-fa598866fbf8 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b" status: 200 len: 1312 microversion: 2.1 time: 0.193556 Jul 14 17:54:58.743202 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 245/415] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:58 2022] GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b => generated 1312 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:59.235011 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-b10f5b4d-3dbe-41b2-b817-bf8483b6b20d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:59.235661 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-b10f5b4d-3dbe-41b2-b817-bf8483b6b20d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:59.238152 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:54:59.243975 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b10f5b4d-3dbe-41b2-b817-bf8483b6b20d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:59.244430 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b10f5b4d-3dbe-41b2-b817-bf8483b6b20d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:59.245206 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b10f5b4d-3dbe-41b2-b817-bf8483b6b20d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:59.245641 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b10f5b4d-3dbe-41b2-b817-bf8483b6b20d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:59.378223 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-b10f5b4d-3dbe-41b2-b817-bf8483b6b20d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:59.386252 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-b10f5b4d-3dbe-41b2-b817-bf8483b6b20d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1521 microversion: 2.1 time: 0.155220 Jul 14 17:54:59.386827 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 171/416] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:59 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:54:59.767747 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-8106aadc-5264-400c-af53-28173cb065e4 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:54:59.768419 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-8106aadc-5264-400c-af53-28173cb065e4 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: a2ceaa41-4d41-41d6-a38b-caf6c587391b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:54:59.775017 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8106aadc-5264-400c-af53-28173cb065e4 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:59.775468 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8106aadc-5264-400c-af53-28173cb065e4 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:59.776275 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8106aadc-5264-400c-af53-28173cb065e4 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:54:59.776716 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8106aadc-5264-400c-af53-28173cb065e4 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:54:59.927534 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-8106aadc-5264-400c-af53-28173cb065e4 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:54:59.936558 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-8106aadc-5264-400c-af53-28173cb065e4 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b" status: 200 len: 1312 microversion: 2.1 time: 0.172874 Jul 14 17:54:59.937316 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 246/417] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:54:59 2022] GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b => generated 1312 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:00.404767 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-62990494-bfbc-4b06-84dc-e334bc81d83f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:00.405375 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-62990494-bfbc-4b06-84dc-e334bc81d83f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:00.411755 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-62990494-bfbc-4b06-84dc-e334bc81d83f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:00.412341 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-62990494-bfbc-4b06-84dc-e334bc81d83f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:00.413128 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-62990494-bfbc-4b06-84dc-e334bc81d83f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:00.413572 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-62990494-bfbc-4b06-84dc-e334bc81d83f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:00.557261 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-62990494-bfbc-4b06-84dc-e334bc81d83f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:00.566479 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-62990494-bfbc-4b06-84dc-e334bc81d83f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1521 microversion: 2.1 time: 0.165529 Jul 14 17:55:00.568048 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 172/418] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:00 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:00.954955 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-ca966530-40c0-4bb5-8c39-c70fb06fdf73 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:00.955557 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-ca966530-40c0-4bb5-8c39-c70fb06fdf73 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: a2ceaa41-4d41-41d6-a38b-caf6c587391b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:00.962194 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ca966530-40c0-4bb5-8c39-c70fb06fdf73 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:00.962644 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ca966530-40c0-4bb5-8c39-c70fb06fdf73 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:00.963529 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ca966530-40c0-4bb5-8c39-c70fb06fdf73 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:00.963994 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ca966530-40c0-4bb5-8c39-c70fb06fdf73 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:01.196066 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-ca966530-40c0-4bb5-8c39-c70fb06fdf73 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:01.211189 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-ca966530-40c0-4bb5-8c39-c70fb06fdf73 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b" status: 200 len: 1312 microversion: 2.1 time: 0.259610 Jul 14 17:55:01.212285 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 247/419] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:00 2022] GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b => generated 1312 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:01.590027 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-0cf13d3f-a5ed-4554-b1da-3eab6ed729b6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:01.591262 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-0cf13d3f-a5ed-4554-b1da-3eab6ed729b6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:01.602722 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0cf13d3f-a5ed-4554-b1da-3eab6ed729b6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:01.603538 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0cf13d3f-a5ed-4554-b1da-3eab6ed729b6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:01.604966 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0cf13d3f-a5ed-4554-b1da-3eab6ed729b6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:01.605773 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0cf13d3f-a5ed-4554-b1da-3eab6ed729b6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:01.613531 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:01.814551 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-0cf13d3f-a5ed-4554-b1da-3eab6ed729b6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:01.824223 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-0cf13d3f-a5ed-4554-b1da-3eab6ed729b6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1521 microversion: 2.1 time: 0.241626 Jul 14 17:55:01.825585 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 173/420] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:01 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:02.232317 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-ab9bd4fa-c3fa-4a42-a40f-617843a40dc0 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:02.233395 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-ab9bd4fa-c3fa-4a42-a40f-617843a40dc0 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: a2ceaa41-4d41-41d6-a38b-caf6c587391b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:02.243762 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ab9bd4fa-c3fa-4a42-a40f-617843a40dc0 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:02.245908 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ab9bd4fa-c3fa-4a42-a40f-617843a40dc0 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:02.248251 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ab9bd4fa-c3fa-4a42-a40f-617843a40dc0 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:02.248251 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ab9bd4fa-c3fa-4a42-a40f-617843a40dc0 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:02.539830 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-ab9bd4fa-c3fa-4a42-a40f-617843a40dc0 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:02.556878 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-ab9bd4fa-c3fa-4a42-a40f-617843a40dc0 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b" status: 200 len: 1312 microversion: 2.1 time: 0.329382 Jul 14 17:55:02.557740 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 248/421] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:02 2022] GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b => generated 1312 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:02.853205 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-e7defa6f-ed94-453d-b9ad-6f453b0d11cd tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:02.853977 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-e7defa6f-ed94-453d-b9ad-6f453b0d11cd tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:02.870316 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e7defa6f-ed94-453d-b9ad-6f453b0d11cd tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:02.871096 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e7defa6f-ed94-453d-b9ad-6f453b0d11cd tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:02.872778 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e7defa6f-ed94-453d-b9ad-6f453b0d11cd tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:02.873740 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e7defa6f-ed94-453d-b9ad-6f453b0d11cd tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:03.150857 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-e7defa6f-ed94-453d-b9ad-6f453b0d11cd tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:03.164771 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-e7defa6f-ed94-453d-b9ad-6f453b0d11cd tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1521 microversion: 2.1 time: 0.318027 Jul 14 17:55:03.165804 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 174/422] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:02 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:03.578947 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-4cbcb7df-ce51-48a8-afa6-6b957486d677 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:03.580117 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-4cbcb7df-ce51-48a8-afa6-6b957486d677 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: a2ceaa41-4d41-41d6-a38b-caf6c587391b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:03.595399 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell0:SELECT=10 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:03.606106 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4cbcb7df-ce51-48a8-afa6-6b957486d677 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:03.606571 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4cbcb7df-ce51-48a8-afa6-6b957486d677 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:03.607425 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4cbcb7df-ce51-48a8-afa6-6b957486d677 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:03.607971 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4cbcb7df-ce51-48a8-afa6-6b957486d677 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:03.838874 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-4cbcb7df-ce51-48a8-afa6-6b957486d677 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:03.854497 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-4cbcb7df-ce51-48a8-afa6-6b957486d677 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b" status: 200 len: 1312 microversion: 2.1 time: 0.281537 Jul 14 17:55:03.855839 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 249/423] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:03 2022] GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b => generated 1312 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:55:04.197087 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-82f76bc1-d289-4232-94b8-bc28f66a2959 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:04.198351 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-82f76bc1-d289-4232-94b8-bc28f66a2959 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:04.213096 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-82f76bc1-d289-4232-94b8-bc28f66a2959 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:04.214695 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-82f76bc1-d289-4232-94b8-bc28f66a2959 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:04.216364 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-82f76bc1-d289-4232-94b8-bc28f66a2959 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:04.217327 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-82f76bc1-d289-4232-94b8-bc28f66a2959 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:04.488145 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-82f76bc1-d289-4232-94b8-bc28f66a2959 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:04.507510 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-82f76bc1-d289-4232-94b8-bc28f66a2959 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1521 microversion: 2.1 time: 0.319857 Jul 14 17:55:04.510150 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 175/424] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:04 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:04.878967 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-f4aabcc3-aebb-42e0-b537-3037e0f6a0a3 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:04.882807 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-f4aabcc3-aebb-42e0-b537-3037e0f6a0a3 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: a2ceaa41-4d41-41d6-a38b-caf6c587391b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:04.886039 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:04.896971 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f4aabcc3-aebb-42e0-b537-3037e0f6a0a3 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:04.897734 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f4aabcc3-aebb-42e0-b537-3037e0f6a0a3 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:04.899485 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f4aabcc3-aebb-42e0-b537-3037e0f6a0a3 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:04.900234 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f4aabcc3-aebb-42e0-b537-3037e0f6a0a3 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:05.164543 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-f4aabcc3-aebb-42e0-b537-3037e0f6a0a3 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:05.177537 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-f4aabcc3-aebb-42e0-b537-3037e0f6a0a3 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b" status: 200 len: 1312 microversion: 2.1 time: 0.306674 Jul 14 17:55:05.179047 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 250/425] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:04 2022] GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b => generated 1312 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:05.532745 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-b016d1c5-3fd6-4dde-adca-0fdb1faaaf5b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:05.533640 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-b016d1c5-3fd6-4dde-adca-0fdb1faaaf5b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:05.542651 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b016d1c5-3fd6-4dde-adca-0fdb1faaaf5b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:05.543276 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b016d1c5-3fd6-4dde-adca-0fdb1faaaf5b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:05.544468 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b016d1c5-3fd6-4dde-adca-0fdb1faaaf5b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:05.545086 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b016d1c5-3fd6-4dde-adca-0fdb1faaaf5b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:05.756699 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-b016d1c5-3fd6-4dde-adca-0fdb1faaaf5b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:05.782714 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-b016d1c5-3fd6-4dde-adca-0fdb1faaaf5b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1521 microversion: 2.1 time: 0.258047 Jul 14 17:55:05.793901 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 176/426] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:05 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:06.202684 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-450f9369-2405-4006-a711-4f416a067a2e tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:06.204023 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-450f9369-2405-4006-a711-4f416a067a2e tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: a2ceaa41-4d41-41d6-a38b-caf6c587391b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:06.211666 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-450f9369-2405-4006-a711-4f416a067a2e tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:06.212805 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-450f9369-2405-4006-a711-4f416a067a2e tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:06.213619 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-450f9369-2405-4006-a711-4f416a067a2e tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:06.214192 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-450f9369-2405-4006-a711-4f416a067a2e tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:06.445262 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-450f9369-2405-4006-a711-4f416a067a2e tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:06.457045 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-450f9369-2405-4006-a711-4f416a067a2e tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b" status: 200 len: 1312 microversion: 2.1 time: 0.258238 Jul 14 17:55:06.457967 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 251/427] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:06 2022] GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b => generated 1312 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:06.766256 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-9e16dc95-522a-49b2-a672-bf98303bf316 req-614594ff-9636-4612-b42c-b2db90c31718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2ceaa41-4d41-41d6-a38b-caf6c587391b", "name": "network-vif-plugged", "status": "completed", "tag": "0f68605a-9311-4160-800d-adf11c0bff9d"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:55:06.789426 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-9e16dc95-522a-49b2-a672-bf98303bf316 req-614594ff-9636-4612-b42c-b2db90c31718 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:06.790087 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-9e16dc95-522a-49b2-a672-bf98303bf316 req-614594ff-9636-4612-b42c-b2db90c31718 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:06.807445 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-0885f351-af21-4033-83b3-38d48686e6aa tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:06.807806 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-9e16dc95-522a-49b2-a672-bf98303bf316 req-614594ff-9636-4612-b42c-b2db90c31718 service nova] Creating event network-vif-plugged:0f68605a-9311-4160-800d-adf11c0bff9d for instance a2ceaa41-4d41-41d6-a38b-caf6c587391b on hv-cinder-84989 Jul 14 17:55:06.809497 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-0885f351-af21-4033-83b3-38d48686e6aa tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:06.813143 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-9e16dc95-522a-49b2-a672-bf98303bf316 req-614594ff-9636-4612-b42c-b2db90c31718 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060934 Jul 14 17:55:06.814209 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 177/428] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 17:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 17:55:06.821473 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0885f351-af21-4033-83b3-38d48686e6aa tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:06.822040 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0885f351-af21-4033-83b3-38d48686e6aa tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:06.822966 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0885f351-af21-4033-83b3-38d48686e6aa tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:06.823474 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0885f351-af21-4033-83b3-38d48686e6aa tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:07.057646 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-0885f351-af21-4033-83b3-38d48686e6aa tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:07.085165 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-0885f351-af21-4033-83b3-38d48686e6aa tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1521 microversion: 2.1 time: 0.286318 Jul 14 17:55:07.085165 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 252/429] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:06 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:07.479954 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-53933966-1e46-413b-92ad-fdb445070f94 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:07.480599 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-53933966-1e46-413b-92ad-fdb445070f94 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: a2ceaa41-4d41-41d6-a38b-caf6c587391b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:07.487844 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-53933966-1e46-413b-92ad-fdb445070f94 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:07.488325 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-53933966-1e46-413b-92ad-fdb445070f94 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:07.489118 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-53933966-1e46-413b-92ad-fdb445070f94 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:07.489586 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-53933966-1e46-413b-92ad-fdb445070f94 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:07.635671 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-53933966-1e46-413b-92ad-fdb445070f94 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:07.645079 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-53933966-1e46-413b-92ad-fdb445070f94 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b" status: 200 len: 1312 microversion: 2.1 time: 0.169415 Jul 14 17:55:07.645665 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 178/430] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:07 2022] GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b => generated 1312 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:55:08.108771 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-729fdd9e-cf93-45b2-9f47-15b57ddf203a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:08.110780 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-729fdd9e-cf93-45b2-9f47-15b57ddf203a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:08.126736 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-729fdd9e-cf93-45b2-9f47-15b57ddf203a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:08.127043 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-729fdd9e-cf93-45b2-9f47-15b57ddf203a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:08.127882 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-729fdd9e-cf93-45b2-9f47-15b57ddf203a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:08.128348 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-729fdd9e-cf93-45b2-9f47-15b57ddf203a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:08.344621 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-729fdd9e-cf93-45b2-9f47-15b57ddf203a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:08.361675 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-729fdd9e-cf93-45b2-9f47-15b57ddf203a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1521 microversion: 2.1 time: 0.252164 Jul 14 17:55:08.362977 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 253/431] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:08 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:08.667984 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-0e0be4a0-1e18-4334-97a3-003860831f35 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:08.669888 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-0e0be4a0-1e18-4334-97a3-003860831f35 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: a2ceaa41-4d41-41d6-a38b-caf6c587391b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:08.685815 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0e0be4a0-1e18-4334-97a3-003860831f35 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:08.686313 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0e0be4a0-1e18-4334-97a3-003860831f35 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:08.687163 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0e0be4a0-1e18-4334-97a3-003860831f35 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:08.687715 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0e0be4a0-1e18-4334-97a3-003860831f35 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:08.917767 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-0e0be4a0-1e18-4334-97a3-003860831f35 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:08.925711 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-0e0be4a0-1e18-4334-97a3-003860831f35 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b" status: 200 len: 1312 microversion: 2.1 time: 0.266115 Jul 14 17:55:08.926430 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 179/432] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:08 2022] GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b => generated 1312 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:09.391844 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-8baa9b1a-f26e-4d4d-981f-b81bec7bddc7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:09.392807 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-8baa9b1a-f26e-4d4d-981f-b81bec7bddc7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:09.405201 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8baa9b1a-f26e-4d4d-981f-b81bec7bddc7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:09.406709 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8baa9b1a-f26e-4d4d-981f-b81bec7bddc7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:09.408325 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8baa9b1a-f26e-4d4d-981f-b81bec7bddc7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:09.409296 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8baa9b1a-f26e-4d4d-981f-b81bec7bddc7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:09.584527 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-8baa9b1a-f26e-4d4d-981f-b81bec7bddc7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:09.593363 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-8baa9b1a-f26e-4d4d-981f-b81bec7bddc7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1521 microversion: 2.1 time: 0.205739 Jul 14 17:55:09.593961 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 254/433] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:09 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:09.950619 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-403b7a9d-5cca-41c3-ba36-979008e43bad tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:09.951565 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-403b7a9d-5cca-41c3-ba36-979008e43bad tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: a2ceaa41-4d41-41d6-a38b-caf6c587391b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:09.959336 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-403b7a9d-5cca-41c3-ba36-979008e43bad tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:09.959824 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-403b7a9d-5cca-41c3-ba36-979008e43bad tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:09.960640 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-403b7a9d-5cca-41c3-ba36-979008e43bad tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:09.961085 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-403b7a9d-5cca-41c3-ba36-979008e43bad tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:10.120538 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-403b7a9d-5cca-41c3-ba36-979008e43bad tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:10.130265 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-403b7a9d-5cca-41c3-ba36-979008e43bad tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b" status: 200 len: 1312 microversion: 2.1 time: 0.183722 Jul 14 17:55:10.131379 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 180/434] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:09 2022] GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b => generated 1312 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:55:10.611514 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-317bb299-434f-4944-9ceb-ab1d0bc82c6b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:10.612431 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-317bb299-434f-4944-9ceb-ab1d0bc82c6b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:10.619650 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-317bb299-434f-4944-9ceb-ab1d0bc82c6b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:10.620183 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-317bb299-434f-4944-9ceb-ab1d0bc82c6b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:10.621147 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-317bb299-434f-4944-9ceb-ab1d0bc82c6b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:10.621598 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-317bb299-434f-4944-9ceb-ab1d0bc82c6b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:10.804618 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-317bb299-434f-4944-9ceb-ab1d0bc82c6b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:10.813718 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-317bb299-434f-4944-9ceb-ab1d0bc82c6b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1521 microversion: 2.1 time: 0.206186 Jul 14 17:55:10.814483 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 255/435] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:10 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:11.149061 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-81426ac3-01cc-456a-8d8e-c3085dd39893 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:11.149683 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-81426ac3-01cc-456a-8d8e-c3085dd39893 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: a2ceaa41-4d41-41d6-a38b-caf6c587391b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:11.157309 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-81426ac3-01cc-456a-8d8e-c3085dd39893 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:11.157782 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-81426ac3-01cc-456a-8d8e-c3085dd39893 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:11.158659 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-81426ac3-01cc-456a-8d8e-c3085dd39893 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:11.159100 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-81426ac3-01cc-456a-8d8e-c3085dd39893 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:11.313867 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-81426ac3-01cc-456a-8d8e-c3085dd39893 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:11.323001 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-81426ac3-01cc-456a-8d8e-c3085dd39893 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b" status: 200 len: 1312 microversion: 2.1 time: 0.178187 Jul 14 17:55:11.323604 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 181/436] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:11 2022] GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b => generated 1312 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:11.832517 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-f2aecda4-2c56-4316-9038-e1b8f70e35cc tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:11.833224 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-f2aecda4-2c56-4316-9038-e1b8f70e35cc tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:11.840707 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f2aecda4-2c56-4316-9038-e1b8f70e35cc tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:11.841170 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f2aecda4-2c56-4316-9038-e1b8f70e35cc tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:11.842004 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f2aecda4-2c56-4316-9038-e1b8f70e35cc tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:11.842467 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f2aecda4-2c56-4316-9038-e1b8f70e35cc tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:12.030824 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-f2aecda4-2c56-4316-9038-e1b8f70e35cc tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:12.043095 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-f2aecda4-2c56-4316-9038-e1b8f70e35cc tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1521 microversion: 2.1 time: 0.214681 Jul 14 17:55:12.044045 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 256/437] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:11 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:12.341942 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-a0326dc0-ce97-4943-b339-ff6670086bfe tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:12.342691 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-a0326dc0-ce97-4943-b339-ff6670086bfe tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: a2ceaa41-4d41-41d6-a38b-caf6c587391b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:12.350351 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a0326dc0-ce97-4943-b339-ff6670086bfe tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:12.350783 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a0326dc0-ce97-4943-b339-ff6670086bfe tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:12.351567 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a0326dc0-ce97-4943-b339-ff6670086bfe tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:12.352049 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a0326dc0-ce97-4943-b339-ff6670086bfe tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:12.520233 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-a0326dc0-ce97-4943-b339-ff6670086bfe tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:12.530558 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-a0326dc0-ce97-4943-b339-ff6670086bfe tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b" status: 200 len: 1312 microversion: 2.1 time: 0.193008 Jul 14 17:55:12.531610 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 182/438] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:12 2022] GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b => generated 1312 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:13.072481 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-c270bc37-b78f-40c9-8e60-cea61489bc92 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:13.073311 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-c270bc37-b78f-40c9-8e60-cea61489bc92 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:13.080496 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c270bc37-b78f-40c9-8e60-cea61489bc92 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:13.081016 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c270bc37-b78f-40c9-8e60-cea61489bc92 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:13.082098 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c270bc37-b78f-40c9-8e60-cea61489bc92 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:13.082586 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c270bc37-b78f-40c9-8e60-cea61489bc92 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:13.238833 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-c270bc37-b78f-40c9-8e60-cea61489bc92 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:13.247787 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-c270bc37-b78f-40c9-8e60-cea61489bc92 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1521 microversion: 2.1 time: 0.179960 Jul 14 17:55:13.248483 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 257/439] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:13 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:13.549171 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-b6f34a50-3290-41f2-b9fe-d3bf02c4170c tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:13.549803 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-b6f34a50-3290-41f2-b9fe-d3bf02c4170c tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: a2ceaa41-4d41-41d6-a38b-caf6c587391b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:13.558751 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b6f34a50-3290-41f2-b9fe-d3bf02c4170c tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:13.559240 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b6f34a50-3290-41f2-b9fe-d3bf02c4170c tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:13.560308 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b6f34a50-3290-41f2-b9fe-d3bf02c4170c tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:13.560899 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b6f34a50-3290-41f2-b9fe-d3bf02c4170c tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:13.738154 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-b6f34a50-3290-41f2-b9fe-d3bf02c4170c tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:13.751832 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-b6f34a50-3290-41f2-b9fe-d3bf02c4170c tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b" status: 200 len: 1312 microversion: 2.1 time: 0.206481 Jul 14 17:55:13.752570 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 183/440] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:13 2022] GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b => generated 1312 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:14.267563 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-adcb735d-d54e-49be-a4d1-d9118415c3fe tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:14.268404 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-adcb735d-d54e-49be-a4d1-d9118415c3fe tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:14.276255 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-adcb735d-d54e-49be-a4d1-d9118415c3fe tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:14.276750 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-adcb735d-d54e-49be-a4d1-d9118415c3fe tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:14.277605 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-adcb735d-d54e-49be-a4d1-d9118415c3fe tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:14.278089 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-adcb735d-d54e-49be-a4d1-d9118415c3fe tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:14.431465 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-adcb735d-d54e-49be-a4d1-d9118415c3fe tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:14.439943 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-adcb735d-d54e-49be-a4d1-d9118415c3fe tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1521 microversion: 2.1 time: 0.176734 Jul 14 17:55:14.440580 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 258/441] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:14 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:14.772384 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-7fda8f04-8251-49f4-804b-fd8ac223272f tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:14.773423 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-7fda8f04-8251-49f4-804b-fd8ac223272f tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: a2ceaa41-4d41-41d6-a38b-caf6c587391b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:14.781858 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7fda8f04-8251-49f4-804b-fd8ac223272f tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:14.782483 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7fda8f04-8251-49f4-804b-fd8ac223272f tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:14.783390 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7fda8f04-8251-49f4-804b-fd8ac223272f tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:14.783954 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7fda8f04-8251-49f4-804b-fd8ac223272f tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:14.943057 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-7fda8f04-8251-49f4-804b-fd8ac223272f tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:14.951607 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-7fda8f04-8251-49f4-804b-fd8ac223272f tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b" status: 200 len: 1312 microversion: 2.1 time: 0.183367 Jul 14 17:55:14.952255 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 184/442] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:14 2022] GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b => generated 1312 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:55:15.459012 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-5e044216-eb41-4373-834e-026f5fa74abb tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:15.459646 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-5e044216-eb41-4373-834e-026f5fa74abb tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:15.466496 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5e044216-eb41-4373-834e-026f5fa74abb tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:15.467011 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5e044216-eb41-4373-834e-026f5fa74abb tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:15.467831 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5e044216-eb41-4373-834e-026f5fa74abb tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:15.468307 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5e044216-eb41-4373-834e-026f5fa74abb tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:15.634233 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-5e044216-eb41-4373-834e-026f5fa74abb tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:15.646443 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-5e044216-eb41-4373-834e-026f5fa74abb tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1521 microversion: 2.1 time: 0.191153 Jul 14 17:55:15.647531 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 259/443] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:15 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:15.969182 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-99fff6c2-dc3e-4b3d-81de-044178e2e47e tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:15.969840 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-99fff6c2-dc3e-4b3d-81de-044178e2e47e tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: a2ceaa41-4d41-41d6-a38b-caf6c587391b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:15.977432 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-99fff6c2-dc3e-4b3d-81de-044178e2e47e tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:15.977887 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-99fff6c2-dc3e-4b3d-81de-044178e2e47e tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:15.978701 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-99fff6c2-dc3e-4b3d-81de-044178e2e47e tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:15.979146 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-99fff6c2-dc3e-4b3d-81de-044178e2e47e tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:16.149765 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-99fff6c2-dc3e-4b3d-81de-044178e2e47e tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:16.158095 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-99fff6c2-dc3e-4b3d-81de-044178e2e47e tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b" status: 200 len: 1495 microversion: 2.1 time: 0.192842 Jul 14 17:55:16.158700 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 185/444] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:15 2022] GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b => generated 1495 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:55:16.666591 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-39897dae-2c2e-429d-a504-fe13fe667ac7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:16.667338 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-39897dae-2c2e-429d-a504-fe13fe667ac7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:16.674017 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-39897dae-2c2e-429d-a504-fe13fe667ac7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:16.674471 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-39897dae-2c2e-429d-a504-fe13fe667ac7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:16.675275 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-39897dae-2c2e-429d-a504-fe13fe667ac7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:16.675731 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-39897dae-2c2e-429d-a504-fe13fe667ac7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:16.855818 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-39897dae-2c2e-429d-a504-fe13fe667ac7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:16.864378 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-39897dae-2c2e-429d-a504-fe13fe667ac7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1521 microversion: 2.1 time: 0.202554 Jul 14 17:55:16.864975 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 260/445] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:16 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:55:17.892623 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-5468e6ce-efaf-446a-931b-198ad7be3eab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:17.893210 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-5468e6ce-efaf-446a-931b-198ad7be3eab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:17.900675 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5468e6ce-efaf-446a-931b-198ad7be3eab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:17.901174 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5468e6ce-efaf-446a-931b-198ad7be3eab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:17.902028 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5468e6ce-efaf-446a-931b-198ad7be3eab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:17.902578 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5468e6ce-efaf-446a-931b-198ad7be3eab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:18.086458 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-5468e6ce-efaf-446a-931b-198ad7be3eab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:18.094896 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-5468e6ce-efaf-446a-931b-198ad7be3eab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1521 microversion: 2.1 time: 0.207502 Jul 14 17:55:18.095496 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 186/446] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:17 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:19.125750 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-5eac61ca-29e3-4525-a72c-fc5505c5293c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:19.129100 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-5eac61ca-29e3-4525-a72c-fc5505c5293c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:19.137559 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5eac61ca-29e3-4525-a72c-fc5505c5293c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:19.138290 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5eac61ca-29e3-4525-a72c-fc5505c5293c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:19.139180 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5eac61ca-29e3-4525-a72c-fc5505c5293c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:19.139826 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5eac61ca-29e3-4525-a72c-fc5505c5293c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:19.161624 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=100 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:19.286897 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-5eac61ca-29e3-4525-a72c-fc5505c5293c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:19.295061 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-5eac61ca-29e3-4525-a72c-fc5505c5293c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1521 microversion: 2.1 time: 0.182441 Jul 14 17:55:19.295668 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 261/447] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:19 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:20.314376 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-75b05efb-7900-4a91-bef5-fe3e86aaeb8a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:20.315195 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-75b05efb-7900-4a91-bef5-fe3e86aaeb8a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:20.323267 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-75b05efb-7900-4a91-bef5-fe3e86aaeb8a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:20.323724 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-75b05efb-7900-4a91-bef5-fe3e86aaeb8a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:20.324604 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-75b05efb-7900-4a91-bef5-fe3e86aaeb8a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:20.325056 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-75b05efb-7900-4a91-bef5-fe3e86aaeb8a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:20.544012 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-75b05efb-7900-4a91-bef5-fe3e86aaeb8a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:20.558393 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-75b05efb-7900-4a91-bef5-fe3e86aaeb8a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1521 microversion: 2.1 time: 0.248106 Jul 14 17:55:20.563123 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 187/448] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:20 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:21.584566 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-00dea3bf-f9bb-4675-b7a0-3d52944e7388 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:21.585286 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-00dea3bf-f9bb-4675-b7a0-3d52944e7388 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:21.592202 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-00dea3bf-f9bb-4675-b7a0-3d52944e7388 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:21.592664 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-00dea3bf-f9bb-4675-b7a0-3d52944e7388 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:21.593481 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-00dea3bf-f9bb-4675-b7a0-3d52944e7388 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:21.593925 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-00dea3bf-f9bb-4675-b7a0-3d52944e7388 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:21.774581 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-00dea3bf-f9bb-4675-b7a0-3d52944e7388 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:21.788455 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-00dea3bf-f9bb-4675-b7a0-3d52944e7388 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1521 microversion: 2.1 time: 0.203986 Jul 14 17:55:21.788455 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 262/449] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:21 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:22.812447 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-f1f062f6-9d52-4d71-9b3f-b6af0727502b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:22.813127 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-f1f062f6-9d52-4d71-9b3f-b6af0727502b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:22.820974 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f1f062f6-9d52-4d71-9b3f-b6af0727502b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:22.821477 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f1f062f6-9d52-4d71-9b3f-b6af0727502b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:22.822381 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f1f062f6-9d52-4d71-9b3f-b6af0727502b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:22.823018 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f1f062f6-9d52-4d71-9b3f-b6af0727502b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:22.974623 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-f1f062f6-9d52-4d71-9b3f-b6af0727502b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:22.983993 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-f1f062f6-9d52-4d71-9b3f-b6af0727502b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1521 microversion: 2.1 time: 0.175519 Jul 14 17:55:22.984601 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 188/450] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:22 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:24.003370 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-bc445aa6-daee-4555-b669-00a384c4c958 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:24.004252 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-bc445aa6-daee-4555-b669-00a384c4c958 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:24.011802 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bc445aa6-daee-4555-b669-00a384c4c958 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:24.012355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bc445aa6-daee-4555-b669-00a384c4c958 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:24.013207 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bc445aa6-daee-4555-b669-00a384c4c958 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:24.013718 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bc445aa6-daee-4555-b669-00a384c4c958 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:24.165718 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-bc445aa6-daee-4555-b669-00a384c4c958 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:24.174413 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-bc445aa6-daee-4555-b669-00a384c4c958 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1521 microversion: 2.1 time: 0.175261 Jul 14 17:55:24.175043 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 263/451] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:23 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:25.192807 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-b30b454f-3dab-43d5-9523-0022be1cee74 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:25.193429 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-b30b454f-3dab-43d5-9523-0022be1cee74 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:25.201096 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b30b454f-3dab-43d5-9523-0022be1cee74 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:25.201548 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b30b454f-3dab-43d5-9523-0022be1cee74 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:25.202607 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b30b454f-3dab-43d5-9523-0022be1cee74 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:25.203064 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b30b454f-3dab-43d5-9523-0022be1cee74 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:25.364468 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-b30b454f-3dab-43d5-9523-0022be1cee74 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:25.373087 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-b30b454f-3dab-43d5-9523-0022be1cee74 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1521 microversion: 2.1 time: 0.184304 Jul 14 17:55:25.373815 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 189/452] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:25 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:26.268270 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-74f6a679-8615-4c0a-aeb9-ec65b88d455f tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:26.269118 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-74f6a679-8615-4c0a-aeb9-ec65b88d455f tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: a2ceaa41-4d41-41d6-a38b-caf6c587391b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:26.276834 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-74f6a679-8615-4c0a-aeb9-ec65b88d455f tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:26.277356 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-74f6a679-8615-4c0a-aeb9-ec65b88d455f tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:26.278072 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-74f6a679-8615-4c0a-aeb9-ec65b88d455f tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:26.278595 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-74f6a679-8615-4c0a-aeb9-ec65b88d455f tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:26.306621 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-74f6a679-8615-4c0a-aeb9-ec65b88d455f tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: a2ceaa41-4d41-41d6-a38b-caf6c587391b] Going to try to terminate instance {{(pid=129471) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 17:55:26.395545 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-03e51760-31a7-4cb7-acdd-4c35f98905d5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:26.396463 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-74f6a679-8615-4c0a-aeb9-ec65b88d455f tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b" status: 204 len: 0 microversion: 2.1 time: 0.131368 Jul 14 17:55:26.396649 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-03e51760-31a7-4cb7-acdd-4c35f98905d5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:26.397850 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 264/453] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Jul 14 17:55:26 2022] DELETE /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 17:55:26.407406 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-03e51760-31a7-4cb7-acdd-4c35f98905d5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:26.408003 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-03e51760-31a7-4cb7-acdd-4c35f98905d5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:26.409016 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-03e51760-31a7-4cb7-acdd-4c35f98905d5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:26.409595 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-03e51760-31a7-4cb7-acdd-4c35f98905d5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:26.409806 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-3987ae61-da2a-474d-9d5f-360df137563d tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:26.410670 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-3987ae61-da2a-474d-9d5f-360df137563d tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: a2ceaa41-4d41-41d6-a38b-caf6c587391b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:26.420076 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3987ae61-da2a-474d-9d5f-360df137563d tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:26.420677 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3987ae61-da2a-474d-9d5f-360df137563d tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:26.421650 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3987ae61-da2a-474d-9d5f-360df137563d tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:26.422194 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3987ae61-da2a-474d-9d5f-360df137563d tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:26.437029 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=100 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:26.685864 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-03e51760-31a7-4cb7-acdd-4c35f98905d5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:26.695263 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-3987ae61-da2a-474d-9d5f-360df137563d tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:26.705470 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-03e51760-31a7-4cb7-acdd-4c35f98905d5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1521 microversion: 2.1 time: 0.315527 Jul 14 17:55:26.706895 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 190/454] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:26 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:55:26.721098 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-3987ae61-da2a-474d-9d5f-360df137563d tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b" status: 200 len: 1501 microversion: 2.1 time: 0.316053 Jul 14 17:55:26.721941 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 265/455] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:26 2022] GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b => generated 1501 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:55:27.736121 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-8cdbab5a-8dc8-4ec3-8ae3-a27f212e1c4e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:27.736121 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-8cdbab5a-8dc8-4ec3-8ae3-a27f212e1c4e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:27.744646 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-446d07fb-4506-470e-ab0a-fff2bb99cbb2 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:27.745514 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-446d07fb-4506-470e-ab0a-fff2bb99cbb2 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: a2ceaa41-4d41-41d6-a38b-caf6c587391b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:27.752276 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-446d07fb-4506-470e-ab0a-fff2bb99cbb2 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:27.753260 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-446d07fb-4506-470e-ab0a-fff2bb99cbb2 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:27.754159 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-446d07fb-4506-470e-ab0a-fff2bb99cbb2 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:27.754766 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-446d07fb-4506-470e-ab0a-fff2bb99cbb2 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:27.762582 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8cdbab5a-8dc8-4ec3-8ae3-a27f212e1c4e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:27.763636 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8cdbab5a-8dc8-4ec3-8ae3-a27f212e1c4e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:27.765397 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8cdbab5a-8dc8-4ec3-8ae3-a27f212e1c4e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:27.766813 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8cdbab5a-8dc8-4ec3-8ae3-a27f212e1c4e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:28.022793 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-446d07fb-4506-470e-ab0a-fff2bb99cbb2 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:28.032367 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-446d07fb-4506-470e-ab0a-fff2bb99cbb2 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b" status: 200 len: 1501 microversion: 2.1 time: 0.293681 Jul 14 17:55:28.033235 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 266/456] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:27 2022] GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b => generated 1501 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:55:28.036594 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-8cdbab5a-8dc8-4ec3-8ae3-a27f212e1c4e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:28.045738 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-8cdbab5a-8dc8-4ec3-8ae3-a27f212e1c4e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1521 microversion: 2.1 time: 0.318512 Jul 14 17:55:28.046429 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 191/457] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:27 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:28.808124 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 17:55:28.809135 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Thu Jul 14 17:55:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 17:55:29.059660 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-a2fff65f-833c-4ed1-a166-aa624e7bfec5 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:29.060484 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-a2fff65f-833c-4ed1-a166-aa624e7bfec5 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: a2ceaa41-4d41-41d6-a38b-caf6c587391b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:29.066244 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-e7d6aa0e-ea1e-4b67-90ee-b41654b2a913 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:29.066941 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a2fff65f-833c-4ed1-a166-aa624e7bfec5 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:29.067165 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-e7d6aa0e-ea1e-4b67-90ee-b41654b2a913 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:29.067393 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a2fff65f-833c-4ed1-a166-aa624e7bfec5 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:29.068223 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a2fff65f-833c-4ed1-a166-aa624e7bfec5 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:29.068666 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a2fff65f-833c-4ed1-a166-aa624e7bfec5 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:29.075610 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e7d6aa0e-ea1e-4b67-90ee-b41654b2a913 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:29.076370 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e7d6aa0e-ea1e-4b67-90ee-b41654b2a913 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:29.077378 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e7d6aa0e-ea1e-4b67-90ee-b41654b2a913 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:29.078284 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e7d6aa0e-ea1e-4b67-90ee-b41654b2a913 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:29.302788 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-a2fff65f-833c-4ed1-a166-aa624e7bfec5 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:29.309321 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-e7d6aa0e-ea1e-4b67-90ee-b41654b2a913 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:29.312058 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-a2fff65f-833c-4ed1-a166-aa624e7bfec5 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b" status: 200 len: 1501 microversion: 2.1 time: 0.256374 Jul 14 17:55:29.312592 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 267/458] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:29 2022] GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b => generated 1501 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:29.325345 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-e7d6aa0e-ea1e-4b67-90ee-b41654b2a913 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1521 microversion: 2.1 time: 0.263763 Jul 14 17:55:29.326425 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 192/459] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:29 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:55:30.331848 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-778fe2b2-5b68-4326-93c5-c7ed6d67fb45 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:30.332555 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-778fe2b2-5b68-4326-93c5-c7ed6d67fb45 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: a2ceaa41-4d41-41d6-a38b-caf6c587391b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:30.339072 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-778fe2b2-5b68-4326-93c5-c7ed6d67fb45 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:30.339522 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-778fe2b2-5b68-4326-93c5-c7ed6d67fb45 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:30.340371 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-778fe2b2-5b68-4326-93c5-c7ed6d67fb45 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:30.340808 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-778fe2b2-5b68-4326-93c5-c7ed6d67fb45 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:30.353713 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-cb333169-def2-4b0c-917e-644ff93d1b3c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:30.354626 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-cb333169-def2-4b0c-917e-644ff93d1b3c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:30.358589 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_api:SELECT=44 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:30.363638 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-cb333169-def2-4b0c-917e-644ff93d1b3c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:30.364187 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-cb333169-def2-4b0c-917e-644ff93d1b3c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:30.364976 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-cb333169-def2-4b0c-917e-644ff93d1b3c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:30.365422 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-cb333169-def2-4b0c-917e-644ff93d1b3c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:30.567423 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-778fe2b2-5b68-4326-93c5-c7ed6d67fb45 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:30.573279 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-cb333169-def2-4b0c-917e-644ff93d1b3c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:30.579301 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-778fe2b2-5b68-4326-93c5-c7ed6d67fb45 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b" status: 200 len: 1501 microversion: 2.1 time: 0.251632 Jul 14 17:55:30.579892 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 268/460] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:30 2022] GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b => generated 1501 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:30.583159 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-cb333169-def2-4b0c-917e-644ff93d1b3c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1521 microversion: 2.1 time: 0.234286 Jul 14 17:55:30.583738 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 193/461] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:30 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:55:31.603415 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-d957d3b4-11f7-4036-adfd-b443a46f91ab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:31.604477 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-d957d3b4-11f7-4036-adfd-b443a46f91ab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:31.610075 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-4d2673d2-b028-44e7-b687-7a6a98242105 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:31.611080 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-4d2673d2-b028-44e7-b687-7a6a98242105 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: a2ceaa41-4d41-41d6-a38b-caf6c587391b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:31.614683 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d957d3b4-11f7-4036-adfd-b443a46f91ab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:31.615431 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d957d3b4-11f7-4036-adfd-b443a46f91ab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:31.616846 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d957d3b4-11f7-4036-adfd-b443a46f91ab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:31.617569 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d957d3b4-11f7-4036-adfd-b443a46f91ab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:31.621847 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4d2673d2-b028-44e7-b687-7a6a98242105 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:31.622567 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4d2673d2-b028-44e7-b687-7a6a98242105 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:31.623876 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4d2673d2-b028-44e7-b687-7a6a98242105 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:31.624624 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4d2673d2-b028-44e7-b687-7a6a98242105 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:31.861417 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-d957d3b4-11f7-4036-adfd-b443a46f91ab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:31.869759 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-4d2673d2-b028-44e7-b687-7a6a98242105 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:31.878118 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-d957d3b4-11f7-4036-adfd-b443a46f91ab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1521 microversion: 2.1 time: 0.280590 Jul 14 17:55:31.878398 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-4d2673d2-b028-44e7-b687-7a6a98242105 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b" status: 200 len: 1501 microversion: 2.1 time: 0.274722 Jul 14 17:55:31.878889 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 194/462] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:31 2022] GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b => generated 1501 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:31.879110 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 269/463] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:31 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:32.903109 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-d0e342aa-c59e-4de6-ab85-10ada79810c8 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:32.904033 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-293df8b2-7010-48ee-b295-37ac791faee8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:32.904701 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-d0e342aa-c59e-4de6-ab85-10ada79810c8 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: a2ceaa41-4d41-41d6-a38b-caf6c587391b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:32.904927 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-293df8b2-7010-48ee-b295-37ac791faee8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:32.911064 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-293df8b2-7010-48ee-b295-37ac791faee8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:32.911524 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-293df8b2-7010-48ee-b295-37ac791faee8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:32.912362 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-293df8b2-7010-48ee-b295-37ac791faee8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:32.912709 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d0e342aa-c59e-4de6-ab85-10ada79810c8 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:32.912926 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-293df8b2-7010-48ee-b295-37ac791faee8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:32.913944 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d0e342aa-c59e-4de6-ab85-10ada79810c8 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:32.914933 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d0e342aa-c59e-4de6-ab85-10ada79810c8 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:32.915539 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d0e342aa-c59e-4de6-ab85-10ada79810c8 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:33.249872 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-293df8b2-7010-48ee-b295-37ac791faee8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:33.259000 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-d0e342aa-c59e-4de6-ab85-10ada79810c8 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:33.268213 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-293df8b2-7010-48ee-b295-37ac791faee8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1521 microversion: 2.1 time: 0.369097 Jul 14 17:55:33.269528 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 270/464] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:32 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1521 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:33.287073 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-d0e342aa-c59e-4de6-ab85-10ada79810c8 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b" status: 200 len: 1501 microversion: 2.1 time: 0.388240 Jul 14 17:55:33.288742 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 195/465] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:32 2022] GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b => generated 1501 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:34.293384 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-786e082a-f09c-4c70-b92e-c0e51078bb34 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:34.294151 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-786e082a-f09c-4c70-b92e-c0e51078bb34 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:34.301310 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-786e082a-f09c-4c70-b92e-c0e51078bb34 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:34.301783 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-786e082a-f09c-4c70-b92e-c0e51078bb34 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:34.302615 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-786e082a-f09c-4c70-b92e-c0e51078bb34 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:34.303054 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-786e082a-f09c-4c70-b92e-c0e51078bb34 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:34.318654 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-e6b0cd78-3da2-4c83-ae6a-8fcdcdeeca50 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:34.321094 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-e6b0cd78-3da2-4c83-ae6a-8fcdcdeeca50 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: a2ceaa41-4d41-41d6-a38b-caf6c587391b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:34.333869 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e6b0cd78-3da2-4c83-ae6a-8fcdcdeeca50 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:34.335618 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e6b0cd78-3da2-4c83-ae6a-8fcdcdeeca50 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:34.337146 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e6b0cd78-3da2-4c83-ae6a-8fcdcdeeca50 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:34.338001 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e6b0cd78-3da2-4c83-ae6a-8fcdcdeeca50 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:34.581443 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-786e082a-f09c-4c70-b92e-c0e51078bb34 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:34.593736 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-786e082a-f09c-4c70-b92e-c0e51078bb34 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1521 microversion: 2.1 time: 0.303745 Jul 14 17:55:34.595131 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 271/466] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:34 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:34.597257 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-e6b0cd78-3da2-4c83-ae6a-8fcdcdeeca50 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:34.608946 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-e6b0cd78-3da2-4c83-ae6a-8fcdcdeeca50 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b" status: 200 len: 1501 microversion: 2.1 time: 0.297103 Jul 14 17:55:34.609833 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 196/467] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:34 2022] GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b => generated 1501 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:35.614087 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-82508d19-1efe-4aaf-b9a8-8226bf28244d req-7f2b37a8-eb96-4ba0-989e-05cde087db30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2ceaa41-4d41-41d6-a38b-caf6c587391b", "name": "network-vif-deleted", "tag": "0f68605a-9311-4160-800d-adf11c0bff9d"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:55:35.615520 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-2b0dc153-fd88-4056-a84e-7bfeb96c86a5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:35.616718 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-2b0dc153-fd88-4056-a84e-7bfeb96c86a5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:35.621861 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:35.623427 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-82508d19-1efe-4aaf-b9a8-8226bf28244d req-7f2b37a8-eb96-4ba0-989e-05cde087db30 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:35.624171 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-82508d19-1efe-4aaf-b9a8-8226bf28244d req-7f2b37a8-eb96-4ba0-989e-05cde087db30 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:35.632988 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2b0dc153-fd88-4056-a84e-7bfeb96c86a5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:35.634023 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2b0dc153-fd88-4056-a84e-7bfeb96c86a5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:35.635485 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2b0dc153-fd88-4056-a84e-7bfeb96c86a5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:35.636333 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2b0dc153-fd88-4056-a84e-7bfeb96c86a5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:35.649124 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-82508d19-1efe-4aaf-b9a8-8226bf28244d req-7f2b37a8-eb96-4ba0-989e-05cde087db30 service nova] Creating event network-vif-deleted:0f68605a-9311-4160-800d-adf11c0bff9d for instance a2ceaa41-4d41-41d6-a38b-caf6c587391b on hv-cinder-84989 Jul 14 17:55:35.658512 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-82508d19-1efe-4aaf-b9a8-8226bf28244d req-7f2b37a8-eb96-4ba0-989e-05cde087db30 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047745 Jul 14 17:55:35.659703 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 197/468] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 17:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 17:55:35.670068 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-afc98697-4e4c-44b2-80a5-d6441022e2f6 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:35.671619 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-afc98697-4e4c-44b2-80a5-d6441022e2f6 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: a2ceaa41-4d41-41d6-a38b-caf6c587391b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:35.682775 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-afc98697-4e4c-44b2-80a5-d6441022e2f6 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:35.683518 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-afc98697-4e4c-44b2-80a5-d6441022e2f6 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:35.684892 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-afc98697-4e4c-44b2-80a5-d6441022e2f6 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:35.685680 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-afc98697-4e4c-44b2-80a5-d6441022e2f6 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:35.822710 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-afc98697-4e4c-44b2-80a5-d6441022e2f6 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:35.836288 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-afc98697-4e4c-44b2-80a5-d6441022e2f6 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b" status: 200 len: 1459 microversion: 2.1 time: 0.174426 Jul 14 17:55:35.837088 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 198/469] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:35 2022] GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b => generated 1459 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:35.938249 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-2b0dc153-fd88-4056-a84e-7bfeb96c86a5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:35.948669 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-2b0dc153-fd88-4056-a84e-7bfeb96c86a5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1521 microversion: 2.1 time: 0.340375 Jul 14 17:55:35.949515 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 272/470] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:35 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1521 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:55:36.864572 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-98b8e814-5153-4622-b022-0c5231ec60cc tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:36.865358 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-98b8e814-5153-4622-b022-0c5231ec60cc tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: a2ceaa41-4d41-41d6-a38b-caf6c587391b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:36.875073 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-98b8e814-5153-4622-b022-0c5231ec60cc tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:36.875527 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-98b8e814-5153-4622-b022-0c5231ec60cc tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:36.876386 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-98b8e814-5153-4622-b022-0c5231ec60cc tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:36.876825 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-98b8e814-5153-4622-b022-0c5231ec60cc tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:36.957043 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-98b8e814-5153-4622-b022-0c5231ec60cc tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:36.966324 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-98b8e814-5153-4622-b022-0c5231ec60cc tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b" status: 200 len: 1297 microversion: 2.1 time: 0.106753 Jul 14 17:55:36.967345 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 199/471] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:36 2022] GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b => generated 1297 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:36.975110 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-97068b15-8760-4452-a011-3ff44b8fb676 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:36.977593 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-97068b15-8760-4452-a011-3ff44b8fb676 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:36.985447 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-97068b15-8760-4452-a011-3ff44b8fb676 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:36.986021 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-97068b15-8760-4452-a011-3ff44b8fb676 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:36.986804 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-97068b15-8760-4452-a011-3ff44b8fb676 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:36.987479 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-97068b15-8760-4452-a011-3ff44b8fb676 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:37.195649 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-97068b15-8760-4452-a011-3ff44b8fb676 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:37.212411 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-97068b15-8760-4452-a011-3ff44b8fb676 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1521 microversion: 2.1 time: 0.246934 Jul 14 17:55:37.213432 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 273/472] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:36 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:55:38.000073 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-0257d179-975c-41d4-91a3-c4a11ce324f5 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:38.001221 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-0257d179-975c-41d4-91a3-c4a11ce324f5 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: a2ceaa41-4d41-41d6-a38b-caf6c587391b] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:38.010788 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0257d179-975c-41d4-91a3-c4a11ce324f5 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:38.011250 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0257d179-975c-41d4-91a3-c4a11ce324f5 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:38.012170 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0257d179-975c-41d4-91a3-c4a11ce324f5 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:38.012618 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0257d179-975c-41d4-91a3-c4a11ce324f5 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:38.050093 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0257d179-975c-41d4-91a3-c4a11ce324f5 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:38.050550 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0257d179-975c-41d4-91a3-c4a11ce324f5 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:38.051019 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.objects.instance [None req-0257d179-975c-41d4-91a3-c4a11ce324f5 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lazy-loading 'fault' on Instance uuid a2ceaa41-4d41-41d6-a38b-caf6c587391b {{(pid=129470) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 17:55:38.124253 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-0257d179-975c-41d4-91a3-c4a11ce324f5 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b3a526943646dcba7bb1806601696b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84353cfe41640e3b13d561b615e1142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:38.135534 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-0257d179-975c-41d4-91a3-c4a11ce324f5 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b" status: 200 len: 1302 microversion: 2.1 time: 0.143853 Jul 14 17:55:38.136371 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 200/473] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:37 2022] GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b => generated 1302 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:38.235515 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-fa703255-7783-4773-aca5-d4bb50b3d84d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:38.236587 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-fa703255-7783-4773-aca5-d4bb50b3d84d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:38.245102 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fa703255-7783-4773-aca5-d4bb50b3d84d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:38.245627 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fa703255-7783-4773-aca5-d4bb50b3d84d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:38.247283 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fa703255-7783-4773-aca5-d4bb50b3d84d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:38.247986 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fa703255-7783-4773-aca5-d4bb50b3d84d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:38.464585 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-fa703255-7783-4773-aca5-d4bb50b3d84d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:38.474015 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-fa703255-7783-4773-aca5-d4bb50b3d84d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1501 microversion: 2.1 time: 0.243115 Jul 14 17:55:38.474964 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 274/474] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:38 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1501 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:38.504487 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-9657f244-4c50-4286-a634-bed337beccab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "609d43f0-96e2-4b69-812d-ea8446e4082d"}} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:55:38.506118 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-9657f244-4c50-4286-a634-bed337beccab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:38.514945 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9657f244-4c50-4286-a634-bed337beccab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:38.515685 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9657f244-4c50-4286-a634-bed337beccab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:38.516538 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9657f244-4c50-4286-a634-bed337beccab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:38.516989 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9657f244-4c50-4286-a634-bed337beccab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:38.535339 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 17:55:38.535983 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Thu Jul 14 17:55:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250/os-volume_attachments (ip 10.222.0.64) !!! Jul 14 17:55:38.563117 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.wsgi [None req-9657f244-4c50-4286-a634-bed337beccab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] HTTP exception thrown: Cannot 'attach_volume' instance 323310aa-bd8a-4a21-9733-b1e73763a250 while it is in vm_state rescued Jul 14 17:55:38.566467 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-9657f244-4c50-4286-a634-bed337beccab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Request method failure captured: Jul 14 17:55:38.566467 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: request: POST /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250/os-volume_attachments HTTP/1.1 Jul 14 17:55:38.566467 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept: application/json Jul 14 17:55:38.566467 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept-Encoding: identity Jul 14 17:55:38.566467 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Connection: close Jul 14 17:55:38.566467 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Length: 74 Jul 14 17:55:38.566467 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Type: application/json Jul 14 17:55:38.566467 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Host: 10.222.0.64 Jul 14 17:55:38.566467 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Openstack-System-Scope: None Jul 14 17:55:38.566467 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: User-Agent: python-urllib3/1.26.9 Jul 14 17:55:38.566467 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Auth-Token: gAAAAABi0FfL6emn5hg2SNahQObVYYShIrtH-f3Fd-CAp1ihyP3qn1qpxmH7972vS_WzpDPVTAyMR2SXNmzXKBpQQN8nUKpUEX5KNrSOtzqNYhKbT7o6DhLBkpLmyAxCB9QiIEyoBCjGxn1ftlUyU7aDfEm3oaSulrngFZzD1cGUryIY_p8LWw4 Jul 14 17:55:38.566467 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Id: None Jul 14 17:55:38.566467 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Name: None Jul 14 17:55:38.566467 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Identity-Status: Confirmed Jul 14 17:55:38.566467 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Is-Admin-Project: True Jul 14 17:55:38.566467 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Id: default Jul 14 17:55:38.566467 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Name: Default Jul 14 17:55:38.566467 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Id: ab58d5c4c0194b58ad47dd5e4494389f Jul 14 17:55:38.566467 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-763337508 Jul 14 17:55:38.566467 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Role: reader,member Jul 14 17:55:38.566467 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Roles: reader,member Jul 14 17:55:38.569472 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ab58d5c4c0194b58ad47dd5e4494389f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ab58d5c4c0194b58ad47dd5e4494389f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ab58d5c4c0194b58ad47dd5e4494389f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ab58d5c4c0194b58ad47dd5e4494389f", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 17:55:38.569472 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant: tempest-ServerRescueNegativeTestJSON-763337508 Jul 14 17:55:38.569472 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Id: ab58d5c4c0194b58ad47dd5e4494389f Jul 14 17:55:38.569472 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-763337508 Jul 14 17:55:38.569472 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User: tempest-ServerRescueNegativeTestJSON-763337508-project Jul 14 17:55:38.569472 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Id: default Jul 14 17:55:38.569472 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Name: Default Jul 14 17:55:38.569472 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Id: 52c794c11ab74f9ca9bad75857043a62 Jul 14 17:55:38.569472 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Name: tempest-ServerRescueNegativeTestJSON-763337508-project Jul 14 17:55:38.569472 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Jul 14 17:55:38.569472 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: {"volumeAttachment": {"volumeId": "609d43f0-96e2-4b69-812d-ea8446e4082d"}} Jul 14 17:55:38.569472 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: method: > Jul 14 17:55:38.571741 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: exception: Cannot 'attach_volume' instance 323310aa-bd8a-4a21-9733-b1e73763a250 while it is in vm_state rescued Jul 14 17:55:38.571741 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: action_args: {'server_id': '323310aa-bd8a-4a21-9733-b1e73763a250', 'body': {'volumeAttachment': {'volumeId': '609d43f0-96e2-4b69-812d-ea8446e4082d'}}} Jul 14 17:55:38.571741 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 17:55:38.571741 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:55:38.571741 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 17:55:38.571741 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 17:55:38.571741 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 17:55:38.571741 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 17:55:38.571741 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 17:55:38.571741 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 17:55:38.571741 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 323310aa-bd8a-4a21-9733-b1e73763a250 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 14 17:55:38.571741 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 17:55:38.571741 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:55:38.571741 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 17:55:38.571741 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:55:38.571741 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:55:38.571741 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:55:38.571741 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 17:55:38.571741 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 17:55:38.574374 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 17:55:38.574374 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 17:55:38.574374 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 17:55:38.574374 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 17:55:38.574374 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 17:55:38.574374 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 17:55:38.574374 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 17:55:38.574374 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 17:55:38.574374 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 14 17:55:38.574374 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 17:55:38.574374 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 17:55:38.574374 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 17:55:38.574374 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 323310aa-bd8a-4a21-9733-b1e73763a250 while it is in vm_state rescued Jul 14 17:55:38.574374 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 17:55:38.574374 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:55:38.574374 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 17:55:38.574374 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:55:38.574374 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:55:38.574374 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:55:38.577301 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 17:55:38.577301 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 17:55:38.577301 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 323310aa-bd8a-4a21-9733-b1e73763a250 while it is in vm_state rescued Jul 14 17:55:38.577301 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 17:55:38.577873 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-9657f244-4c50-4286-a634-bed337beccab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Returning 409 to user: Cannot 'attach_volume' instance 323310aa-bd8a-4a21-9733-b1e73763a250 while it is in vm_state rescued {{(pid=129470) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 17:55:38.579438 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-9657f244-4c50-4286-a634-bed337beccab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "POST /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.081067 Jul 14 17:55:38.579654 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 201/475] 10.222.0.64 () {60 vars in 1322 bytes} [Thu Jul 14 17:55:38 2022] POST /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250/os-volume_attachments => generated 152 bytes in 83 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 17:55:38.589307 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-f7bd85ee-e6a2-453d-b680-5dee01f58eca tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:55:38.589858 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-f7bd85ee-e6a2-453d-b680-5dee01f58eca tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:38.596501 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f7bd85ee-e6a2-453d-b680-5dee01f58eca tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:38.596959 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f7bd85ee-e6a2-453d-b680-5dee01f58eca tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:38.597753 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f7bd85ee-e6a2-453d-b680-5dee01f58eca tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:38.598186 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f7bd85ee-e6a2-453d-b680-5dee01f58eca tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:38.666710 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:38.716012 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-f7bd85ee-e6a2-453d-b680-5dee01f58eca tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "POST /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250/action" status: 202 len: 0 microversion: 2.1 time: 0.130315 Jul 14 17:55:38.719527 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 275/476] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Jul 14 17:55:38 2022] POST /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 17:55:38.730849 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-992be0a1-770f-4383-a66d-30ca66efb886 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:38.732264 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-992be0a1-770f-4383-a66d-30ca66efb886 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:38.747365 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-992be0a1-770f-4383-a66d-30ca66efb886 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:38.748175 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-992be0a1-770f-4383-a66d-30ca66efb886 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:38.750466 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-992be0a1-770f-4383-a66d-30ca66efb886 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:38.752701 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-992be0a1-770f-4383-a66d-30ca66efb886 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:38.976752 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-992be0a1-770f-4383-a66d-30ca66efb886 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:38.992375 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-992be0a1-770f-4383-a66d-30ca66efb886 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1509 microversion: 2.1 time: 0.268662 Jul 14 17:55:38.994289 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 202/477] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:38 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1509 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:39.158154 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-773b06a2-cdc2-4cd3-985d-2fc49f7c7714 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:39.159377 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-773b06a2-cdc2-4cd3-985d-2fc49f7c7714 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] [instance: a2ceaa41-4d41-41d6-a38b-caf6c587391b] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:39.176546 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-773b06a2-cdc2-4cd3-985d-2fc49f7c7714 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:39.177829 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-773b06a2-cdc2-4cd3-985d-2fc49f7c7714 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:39.179754 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-773b06a2-cdc2-4cd3-985d-2fc49f7c7714 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:39.181055 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-773b06a2-cdc2-4cd3-985d-2fc49f7c7714 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:39.207305 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.wsgi [None req-773b06a2-cdc2-4cd3-985d-2fc49f7c7714 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] HTTP exception thrown: Instance a2ceaa41-4d41-41d6-a38b-caf6c587391b could not be found. Jul 14 17:55:39.211902 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-773b06a2-cdc2-4cd3-985d-2fc49f7c7714 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Request method failure captured: Jul 14 17:55:39.211902 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: request: GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b HTTP/1.1 Jul 14 17:55:39.211902 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept: application/json Jul 14 17:55:39.211902 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept-Encoding: identity Jul 14 17:55:39.211902 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Connection: close Jul 14 17:55:39.211902 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Length: 0 Jul 14 17:55:39.211902 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Type: application/json Jul 14 17:55:39.211902 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Host: 10.222.0.64 Jul 14 17:55:39.211902 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Openstack-System-Scope: None Jul 14 17:55:39.211902 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: User-Agent: python-urllib3/1.26.9 Jul 14 17:55:39.211902 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Auth-Token: gAAAAABi0FhFWdiR9VgINOMVfAEZOTZVw5pE3hcY5rB5GzhEXbkc-PodyEJVZk7atEovJT-QgJSV4ISQmwdW_XAcaVrLslV-O7OTkc26F5sbpPPJ9Hm5l6Cvv33pqcSuwhVIaIJkMGKmsjUZ9pziRLZjIPjudLvY9CvpHnXtxHdlERVSi_TPcGo Jul 14 17:55:39.211902 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Id: None Jul 14 17:55:39.211902 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Name: None Jul 14 17:55:39.211902 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Identity-Status: Confirmed Jul 14 17:55:39.211902 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Is-Admin-Project: True Jul 14 17:55:39.211902 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Id: default Jul 14 17:55:39.211902 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Name: Default Jul 14 17:55:39.211902 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Id: a84353cfe41640e3b13d561b615e1142 Jul 14 17:55:39.211902 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Name: tempest-VolumesActionsTest-205937016 Jul 14 17:55:39.211902 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Role: reader,member Jul 14 17:55:39.211902 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Roles: reader,member Jul 14 17:55:39.214456 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a84353cfe41640e3b13d561b615e1142"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a84353cfe41640e3b13d561b615e1142"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a84353cfe41640e3b13d561b615e1142"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a84353cfe41640e3b13d561b615e1142", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 17:55:39.214456 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant: tempest-VolumesActionsTest-205937016 Jul 14 17:55:39.214456 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Id: a84353cfe41640e3b13d561b615e1142 Jul 14 17:55:39.214456 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Name: tempest-VolumesActionsTest-205937016 Jul 14 17:55:39.214456 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User: tempest-VolumesActionsTest-205937016-project Jul 14 17:55:39.214456 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Id: default Jul 14 17:55:39.214456 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Name: Default Jul 14 17:55:39.214456 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Id: d3b3a526943646dcba7bb1806601696b Jul 14 17:55:39.214456 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Name: tempest-VolumesActionsTest-205937016-project Jul 14 17:55:39.214456 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: method: > Jul 14 17:55:39.214456 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: exception: Instance a2ceaa41-4d41-41d6-a38b-caf6c587391b could not be found. Jul 14 17:55:39.214456 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: action_args: {'id': 'a2ceaa41-4d41-41d6-a38b-caf6c587391b'} Jul 14 17:55:39.215846 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 17:55:39.215846 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:55:39.215846 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 17:55:39.215846 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 17:55:39.215846 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 17:55:39.215846 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 17:55:39.215846 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 17:55:39.215846 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 17:55:39.215846 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 17:55:39.215846 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 17:55:39.215846 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2ceaa41-4d41-41d6-a38b-caf6c587391b could not be found. Jul 14 17:55:39.215846 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:55:39.215846 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:55:39.215846 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:55:39.215846 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:55:39.215846 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:55:39.215846 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:55:39.215846 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 17:55:39.215846 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 17:55:39.215846 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 17:55:39.219287 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 17:55:39.219287 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 17:55:39.219287 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 17:55:39.219287 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 17:55:39.219287 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 17:55:39.219287 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 17:55:39.219287 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 17:55:39.219287 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2ceaa41-4d41-41d6-a38b-caf6c587391b could not be found. Jul 14 17:55:39.219287 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:55:39.219287 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:55:39.219287 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:55:39.219287 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:55:39.219287 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:55:39.219287 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:55:39.219287 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 17:55:39.219287 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 17:55:39.219287 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2ceaa41-4d41-41d6-a38b-caf6c587391b could not be found. Jul 14 17:55:39.219287 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:55:39.222027 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-773b06a2-cdc2-4cd3-985d-2fc49f7c7714 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] Returning 404 to user: Instance a2ceaa41-4d41-41d6-a38b-caf6c587391b could not be found. {{(pid=129471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 17:55:39.222027 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-773b06a2-cdc2-4cd3-985d-2fc49f7c7714 tempest-VolumesActionsTest-205937016 tempest-VolumesActionsTest-205937016-project] 10.222.0.64 "GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b" status: 404 len: 111 microversion: 2.1 time: 0.063313 Jul 14 17:55:39.222027 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 276/478] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:39 2022] GET /compute/v2.1/servers/a2ceaa41-4d41-41d6-a38b-caf6c587391b => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 17:55:40.013824 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-140cf866-abc7-41e6-8913-c4374fe86063 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:40.015793 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-140cf866-abc7-41e6-8913-c4374fe86063 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:40.024417 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-140cf866-abc7-41e6-8913-c4374fe86063 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:40.025284 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-140cf866-abc7-41e6-8913-c4374fe86063 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:40.026332 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-140cf866-abc7-41e6-8913-c4374fe86063 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:40.027032 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-140cf866-abc7-41e6-8913-c4374fe86063 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:40.518233 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-140cf866-abc7-41e6-8913-c4374fe86063 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:40.535146 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-140cf866-abc7-41e6-8913-c4374fe86063 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1509 microversion: 2.1 time: 0.525682 Jul 14 17:55:40.537455 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 203/479] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:40 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1509 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:55:41.565155 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-9ba479e7-9994-4f76-bef5-8e482aea881a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:41.566282 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-9ba479e7-9994-4f76-bef5-8e482aea881a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:41.579388 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9ba479e7-9994-4f76-bef5-8e482aea881a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:41.579388 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9ba479e7-9994-4f76-bef5-8e482aea881a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:41.581203 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9ba479e7-9994-4f76-bef5-8e482aea881a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:41.582010 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9ba479e7-9994-4f76-bef5-8e482aea881a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:41.841306 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-9ba479e7-9994-4f76-bef5-8e482aea881a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:41.854070 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-9ba479e7-9994-4f76-bef5-8e482aea881a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1509 microversion: 2.1 time: 0.296136 Jul 14 17:55:41.854513 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 277/480] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:41 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1509 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:42.883238 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-0933ff3c-1cca-4da0-8939-f5e8ac8b0e22 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:42.884128 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-0933ff3c-1cca-4da0-8939-f5e8ac8b0e22 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:42.891137 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0933ff3c-1cca-4da0-8939-f5e8ac8b0e22 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:42.891586 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0933ff3c-1cca-4da0-8939-f5e8ac8b0e22 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:42.892428 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0933ff3c-1cca-4da0-8939-f5e8ac8b0e22 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:42.893088 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0933ff3c-1cca-4da0-8939-f5e8ac8b0e22 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:43.133813 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-0933ff3c-1cca-4da0-8939-f5e8ac8b0e22 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:43.142461 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-0933ff3c-1cca-4da0-8939-f5e8ac8b0e22 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1509 microversion: 2.1 time: 0.263683 Jul 14 17:55:43.143057 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 204/481] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:42 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1509 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:55:44.165404 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-7f2abc53-1dff-4b1c-9dbf-af1b4319d4f1 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:44.168889 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-7f2abc53-1dff-4b1c-9dbf-af1b4319d4f1 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:44.182901 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7f2abc53-1dff-4b1c-9dbf-af1b4319d4f1 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:44.183986 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7f2abc53-1dff-4b1c-9dbf-af1b4319d4f1 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:44.185835 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7f2abc53-1dff-4b1c-9dbf-af1b4319d4f1 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:44.186743 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7f2abc53-1dff-4b1c-9dbf-af1b4319d4f1 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:44.399038 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-7f2abc53-1dff-4b1c-9dbf-af1b4319d4f1 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:44.412273 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-7f2abc53-1dff-4b1c-9dbf-af1b4319d4f1 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1509 microversion: 2.1 time: 0.253575 Jul 14 17:55:44.413286 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 278/482] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:44 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1509 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:45.432745 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-9d3c9eb9-2264-44f9-af41-a3371fc51587 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:45.435400 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-9d3c9eb9-2264-44f9-af41-a3371fc51587 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:45.443015 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9d3c9eb9-2264-44f9-af41-a3371fc51587 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:45.443775 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9d3c9eb9-2264-44f9-af41-a3371fc51587 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:45.444632 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9d3c9eb9-2264-44f9-af41-a3371fc51587 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:45.445578 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9d3c9eb9-2264-44f9-af41-a3371fc51587 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:45.684712 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-9d3c9eb9-2264-44f9-af41-a3371fc51587 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:45.703442 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-9d3c9eb9-2264-44f9-af41-a3371fc51587 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1509 microversion: 2.1 time: 0.276366 Jul 14 17:55:45.705296 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 205/483] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:45 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1509 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:55:46.727967 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-cabcd0f5-c1f9-4ae8-997c-5f37879d7db2 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:46.732707 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-cabcd0f5-c1f9-4ae8-997c-5f37879d7db2 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:46.773809 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-cabcd0f5-c1f9-4ae8-997c-5f37879d7db2 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:46.774546 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-cabcd0f5-c1f9-4ae8-997c-5f37879d7db2 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:46.775884 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-cabcd0f5-c1f9-4ae8-997c-5f37879d7db2 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:46.776649 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-cabcd0f5-c1f9-4ae8-997c-5f37879d7db2 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:47.021150 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-cabcd0f5-c1f9-4ae8-997c-5f37879d7db2 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:47.030793 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-cabcd0f5-c1f9-4ae8-997c-5f37879d7db2 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1509 microversion: 2.1 time: 0.310047 Jul 14 17:55:47.032104 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 279/484] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:46 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1509 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:48.063421 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-a9380865-a7c0-4d99-9fea-93f6de66d6f7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:48.066012 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-a9380865-a7c0-4d99-9fea-93f6de66d6f7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:48.081046 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a9380865-a7c0-4d99-9fea-93f6de66d6f7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:48.081639 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a9380865-a7c0-4d99-9fea-93f6de66d6f7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:48.082307 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a9380865-a7c0-4d99-9fea-93f6de66d6f7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:48.082754 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a9380865-a7c0-4d99-9fea-93f6de66d6f7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:48.362702 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-a016b23e-ad06-4612-bfc7-b975983393db tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-640067665", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2119343121", "security_groups": [{"name": "tempest-secgroup-smoke-1372274107"}], "networks": [{"uuid": "57190352-5968-4ebe-b16b-6269fff539a1"}], "block_device_mapping_v2": [{"uuid": "dedea50a-f888-494a-ac59-fe8bb8e4e4e9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:55:48.549164 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-a9380865-a7c0-4d99-9fea-93f6de66d6f7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:48.610538 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-a9380865-a7c0-4d99-9fea-93f6de66d6f7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1515 microversion: 2.1 time: 0.550123 Jul 14 17:55:48.612383 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 206/485] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:48 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1515 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:55:48.708093 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.network.neutron [None req-a016b23e-ad06-4612-bfc7-b975983393db tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] validate_networks() for [('57190352-5968-4ebe-b16b-6269fff539a1', None, None, None, None, None)] {{(pid=129471) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 17:55:49.513772 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-a016b23e-ad06-4612-bfc7-b975983393db tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Flavor limits 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 17:55:49.515634 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-a016b23e-ad06-4612-bfc7-b975983393db tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Image limits 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 17:55:49.517362 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-a016b23e-ad06-4612-bfc7-b975983393db tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Flavor pref 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 17:55:49.519220 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-a016b23e-ad06-4612-bfc7-b975983393db tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Image pref 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 17:55:49.520230 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-a016b23e-ad06-4612-bfc7-b975983393db tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 17:55:49.551008 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a016b23e-ad06-4612-bfc7-b975983393db tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:49.552666 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a016b23e-ad06-4612-bfc7-b975983393db tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:49.561879 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a016b23e-ad06-4612-bfc7-b975983393db tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:49.564163 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a016b23e-ad06-4612-bfc7-b975983393db tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:49.661914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.quota [None req-a016b23e-ad06-4612-bfc7-b975983393db tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Getting quotas for project 96004c35e9a84f2ab6b0601e28f45627. Resources: {'ram', 'cores', 'instances'} {{(pid=129471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 17:55:49.678205 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.quota [None req-a016b23e-ad06-4612-bfc7-b975983393db tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Getting quotas for user 5d24ace76e3e4f10b63a53bb7482ac07 and project 96004c35e9a84f2ab6b0601e28f45627. Resources: {'ram', 'cores', 'instances'} {{(pid=129471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 17:55:49.817788 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-a016b23e-ad06-4612-bfc7-b975983393db tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Going to run 1 instances... {{(pid=129471) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 17:55:49.822436 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-a016b23e-ad06-4612-bfc7-b975983393db tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dedea50a-f888-494a-ac59-fe8bb8e4e4e9',volume_size=None,volume_type=None)] {{(pid=129471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 17:55:50.134226 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-a016b23e-ad06-4612-bfc7-b975983393db tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.780571 Jul 14 17:55:50.134948 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 280/486] 10.222.0.64 () {60 vars in 1146 bytes} [Thu Jul 14 17:55:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 1787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 17:55:50.153966 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-dea0f8cf-e5cd-47e5-bb18-7154029993f7 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:50.155352 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-dea0f8cf-e5cd-47e5-bb18-7154029993f7 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:50.329086 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-dea0f8cf-e5cd-47e5-bb18-7154029993f7 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:50.348730 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-dea0f8cf-e5cd-47e5-bb18-7154029993f7 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1088 microversion: 2.1 time: 0.205834 Jul 14 17:55:50.350686 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 207/487] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:50 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1088 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:51.371210 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-45c620a8-6ea1-4e8c-86fa-d9de3012b316 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:51.373605 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-45c620a8-6ea1-4e8c-86fa-d9de3012b316 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:51.386779 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-45c620a8-6ea1-4e8c-86fa-d9de3012b316 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:51.388591 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-45c620a8-6ea1-4e8c-86fa-d9de3012b316 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:51.392315 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-45c620a8-6ea1-4e8c-86fa-d9de3012b316 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:51.395475 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-45c620a8-6ea1-4e8c-86fa-d9de3012b316 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:51.511106 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-45c620a8-6ea1-4e8c-86fa-d9de3012b316 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:51.522644 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-45c620a8-6ea1-4e8c-86fa-d9de3012b316 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1130 microversion: 2.1 time: 0.156438 Jul 14 17:55:51.523634 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 281/488] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:51 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1130 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:51.932212 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-e9f6cf27-0718-435b-b2cc-54a7da045e0f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Action: 'create', calling method: .version_select at 0x7f1380204550>, body: {"keypair": {"name": "tempest-keypair-637825620", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/8zkNrUaNK188S9nYXZF2XlxI5WP2tX2ww/lJaujBP4uw7GGLy1ngf+t8jM6ptSAhfluSWvWj1f6MqjkxCfI5HLiFF6tS2ehsV/drUiGn6j+PJsq72IAkF9DHfzE1LNg=="}} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:55:51.985512 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.quota [None req-e9f6cf27-0718-435b-b2cc-54a7da045e0f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Getting quotas for project ab58d5c4c0194b58ad47dd5e4494389f. Resources: {'key_pairs'} {{(pid=129470) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 17:55:52.002095 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.quota [None req-e9f6cf27-0718-435b-b2cc-54a7da045e0f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Getting quotas for user 52c794c11ab74f9ca9bad75857043a62 and project ab58d5c4c0194b58ad47dd5e4494389f. Resources: {'key_pairs'} {{(pid=129470) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 17:55:52.072892 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-e9f6cf27-0718-435b-b2cc-54a7da045e0f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.145197 Jul 14 17:55:52.075723 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 208/489] 10.222.0.64 () {60 vars in 1158 bytes} [Thu Jul 14 17:55:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 17:55:52.544138 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-8db4c244-b60c-4a43-ad8e-61101eb4db04 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:52.545609 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-8db4c244-b60c-4a43-ad8e-61101eb4db04 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:52.557517 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8db4c244-b60c-4a43-ad8e-61101eb4db04 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:52.558387 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8db4c244-b60c-4a43-ad8e-61101eb4db04 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:52.560439 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8db4c244-b60c-4a43-ad8e-61101eb4db04 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:52.564500 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8db4c244-b60c-4a43-ad8e-61101eb4db04 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:52.876006 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-8db4c244-b60c-4a43-ad8e-61101eb4db04 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:52.894184 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-8db4c244-b60c-4a43-ad8e-61101eb4db04 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1204 microversion: 2.1 time: 0.355606 Jul 14 17:55:52.899986 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 282/490] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:52 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1204 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:53.927916 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-969a730f-6094-427f-84ef-301a71d07c8a tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:53.932823 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-969a730f-6094-427f-84ef-301a71d07c8a tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:53.979775 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-969a730f-6094-427f-84ef-301a71d07c8a tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:53.980718 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-969a730f-6094-427f-84ef-301a71d07c8a tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:53.982355 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-969a730f-6094-427f-84ef-301a71d07c8a tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:53.993958 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-969a730f-6094-427f-84ef-301a71d07c8a tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:54.262355 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-969a730f-6094-427f-84ef-301a71d07c8a tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:54.279826 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=100 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:54.288340 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-969a730f-6094-427f-84ef-301a71d07c8a tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1192 microversion: 2.1 time: 0.370871 Jul 14 17:55:54.291082 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 209/491] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:53 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1192 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:55:55.308667 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-8498b833-54e3-4485-a445-abdfe83c4b4d tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:55.309289 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-8498b833-54e3-4485-a445-abdfe83c4b4d tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:55.331402 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8498b833-54e3-4485-a445-abdfe83c4b4d tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:55.331837 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8498b833-54e3-4485-a445-abdfe83c4b4d tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:55.332719 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8498b833-54e3-4485-a445-abdfe83c4b4d tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:55.333355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8498b833-54e3-4485-a445-abdfe83c4b4d tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:55.472168 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-8498b833-54e3-4485-a445-abdfe83c4b4d tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:55.484678 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-8498b833-54e3-4485-a445-abdfe83c4b4d tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1192 microversion: 2.1 time: 0.180270 Jul 14 17:55:55.485996 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 283/492] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:55 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1192 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:56.115266 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-6e73e48a-8f48-4e73-b977-18a77882d6b0 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-794887576", "imageRef": "cf1f5d8c-9e49-4272-8e19-8e3c587056e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f0a7a3b8-c0d5-44f2-8b6f-863a45d618db"}], "security_groups": [{"name": "tempest-securitygroup--1000965026"}], "key_name": "tempest-keypair-637825620", "user_data": "}} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:55:56.354482 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.network.neutron [None req-6e73e48a-8f48-4e73-b977-18a77882d6b0 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] validate_networks() for [('f0a7a3b8-c0d5-44f2-8b6f-863a45d618db', None, None, None, None, None)] {{(pid=129470) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 17:55:56.517263 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-c6f2b131-54ee-4821-8bf9-b4ceaf7f289e tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:56.519746 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-c6f2b131-54ee-4821-8bf9-b4ceaf7f289e tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:56.533620 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c6f2b131-54ee-4821-8bf9-b4ceaf7f289e tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:56.534941 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c6f2b131-54ee-4821-8bf9-b4ceaf7f289e tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:56.536829 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c6f2b131-54ee-4821-8bf9-b4ceaf7f289e tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:56.538002 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c6f2b131-54ee-4821-8bf9-b4ceaf7f289e tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:56.948803 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-c6f2b131-54ee-4821-8bf9-b4ceaf7f289e tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:56.980448 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-c6f2b131-54ee-4821-8bf9-b4ceaf7f289e tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1260 microversion: 2.1 time: 0.466927 Jul 14 17:55:56.991991 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 284/493] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:56 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1260 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:57.200900 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-6e73e48a-8f48-4e73-b977-18a77882d6b0 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Flavor limits 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 17:55:57.201747 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-6e73e48a-8f48-4e73-b977-18a77882d6b0 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Image limits 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 17:55:57.201921 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-6e73e48a-8f48-4e73-b977-18a77882d6b0 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Flavor pref 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 17:55:57.202184 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-6e73e48a-8f48-4e73-b977-18a77882d6b0 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Image pref 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 17:55:57.202596 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-6e73e48a-8f48-4e73-b977-18a77882d6b0 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 17:55:57.219708 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6e73e48a-8f48-4e73-b977-18a77882d6b0 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:57.220210 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6e73e48a-8f48-4e73-b977-18a77882d6b0 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:57.221590 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6e73e48a-8f48-4e73-b977-18a77882d6b0 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:57.222065 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6e73e48a-8f48-4e73-b977-18a77882d6b0 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:57.249845 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.quota [None req-6e73e48a-8f48-4e73-b977-18a77882d6b0 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Getting quotas for project ab58d5c4c0194b58ad47dd5e4494389f. Resources: {'ram', 'cores', 'instances'} {{(pid=129470) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 17:55:57.255310 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.quota [None req-6e73e48a-8f48-4e73-b977-18a77882d6b0 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Getting quotas for user 52c794c11ab74f9ca9bad75857043a62 and project ab58d5c4c0194b58ad47dd5e4494389f. Resources: {'ram', 'cores', 'instances'} {{(pid=129470) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 17:55:57.270752 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-6e73e48a-8f48-4e73-b977-18a77882d6b0 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Going to run 1 instances... {{(pid=129470) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 17:55:57.275100 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-6e73e48a-8f48-4e73-b977-18a77882d6b0 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf1f5d8c-9e49-4272-8e19-8e3c587056e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129470) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 17:55:57.338165 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-6e73e48a-8f48-4e73-b977-18a77882d6b0 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.234019 Jul 14 17:55:57.339665 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 210/494] 10.222.0.64 () {60 vars in 1146 bytes} [Thu Jul 14 17:55:56 2022] POST /compute/v2.1/servers => generated 409 bytes in 1237 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 17:55:57.354858 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-162462af-d1d9-4ff9-8957-fb2febf6f6d1 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:57.355813 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-162462af-d1d9-4ff9-8957-fb2febf6f6d1 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:57.585408 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-162462af-d1d9-4ff9-8957-fb2febf6f6d1 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:57.612437 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-162462af-d1d9-4ff9-8957-fb2febf6f6d1 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 200 len: 1244 microversion: 2.1 time: 0.259265 Jul 14 17:55:57.616835 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 285/495] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:57 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 1244 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:58.005621 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-c926e196-852f-468f-b107-5eb8174409e9 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:58.007082 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-c926e196-852f-468f-b107-5eb8174409e9 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:58.020057 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c926e196-852f-468f-b107-5eb8174409e9 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:58.021293 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c926e196-852f-468f-b107-5eb8174409e9 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:58.025456 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c926e196-852f-468f-b107-5eb8174409e9 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:58.026958 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c926e196-852f-468f-b107-5eb8174409e9 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:58.524005 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-c926e196-852f-468f-b107-5eb8174409e9 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:58.538063 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-c926e196-852f-468f-b107-5eb8174409e9 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1260 microversion: 2.1 time: 0.540998 Jul 14 17:55:58.541992 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 211/496] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:57 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1260 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:58.642696 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-d310a9af-5b65-4ba6-944a-ad18450ba1a9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:58.643333 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-d310a9af-5b65-4ba6-944a-ad18450ba1a9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:58.655077 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d310a9af-5b65-4ba6-944a-ad18450ba1a9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:58.655626 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d310a9af-5b65-4ba6-944a-ad18450ba1a9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:58.656381 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d310a9af-5b65-4ba6-944a-ad18450ba1a9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:58.656831 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d310a9af-5b65-4ba6-944a-ad18450ba1a9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:58.787039 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-d310a9af-5b65-4ba6-944a-ad18450ba1a9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:55:58.801993 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-d310a9af-5b65-4ba6-944a-ad18450ba1a9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 200 len: 1248 microversion: 2.1 time: 0.157283 Jul 14 17:55:58.812597 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 286/497] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:58 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 1248 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:55:58.936924 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-11f71c3a-f5f6-464a-8a52-0dd6707602a3 req-16a61277-1501-4407-96b3-74775085676e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28947673-5bde-4923-9e70-bec5086fe9c6", "tag": "2f38f011-fe4c-4851-b4df-370ae6045e1f"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:55:58.951834 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-11f71c3a-f5f6-464a-8a52-0dd6707602a3 req-16a61277-1501-4407-96b3-74775085676e service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:58.952612 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-11f71c3a-f5f6-464a-8a52-0dd6707602a3 req-16a61277-1501-4407-96b3-74775085676e service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:58.982929 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-11f71c3a-f5f6-464a-8a52-0dd6707602a3 req-16a61277-1501-4407-96b3-74775085676e service nova] Creating event network-changed:2f38f011-fe4c-4851-b4df-370ae6045e1f for instance 28947673-5bde-4923-9e70-bec5086fe9c6 on hv-cinder-84989 Jul 14 17:55:58.992358 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-11f71c3a-f5f6-464a-8a52-0dd6707602a3 req-16a61277-1501-4407-96b3-74775085676e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059011 Jul 14 17:55:58.998291 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 212/498] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 17:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 17:55:59.570198 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-c7677fcd-20cf-4a4d-b784-4f4721f907b3 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:59.571502 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-c7677fcd-20cf-4a4d-b784-4f4721f907b3 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:59.583320 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c7677fcd-20cf-4a4d-b784-4f4721f907b3 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:59.588079 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c7677fcd-20cf-4a4d-b784-4f4721f907b3 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:59.589253 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c7677fcd-20cf-4a4d-b784-4f4721f907b3 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:59.592412 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c7677fcd-20cf-4a4d-b784-4f4721f907b3 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:59.654213 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell0:SELECT=2 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:59.820195 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-99c45afc-8bfe-4b13-9bde-edd0ca8207b8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:55:59.821202 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-99c45afc-8bfe-4b13-9bde-edd0ca8207b8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:55:59.838502 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-99c45afc-8bfe-4b13-9bde-edd0ca8207b8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:59.839072 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-99c45afc-8bfe-4b13-9bde-edd0ca8207b8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:55:59.840003 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-99c45afc-8bfe-4b13-9bde-edd0ca8207b8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:55:59.840536 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-99c45afc-8bfe-4b13-9bde-edd0ca8207b8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:00.151595 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-99c45afc-8bfe-4b13-9bde-edd0ca8207b8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:00.166100 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-99c45afc-8bfe-4b13-9bde-edd0ca8207b8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 200 len: 1304 microversion: 2.1 time: 0.349201 Jul 14 17:56:00.166815 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 213/499] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:59 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 1304 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:00.556869 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-c7677fcd-20cf-4a4d-b784-4f4721f907b3 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:00.572750 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-c7677fcd-20cf-4a4d-b784-4f4721f907b3 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1260 microversion: 2.1 time: 1.000353 Jul 14 17:56:00.583516 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 287/500] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:55:59 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1260 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:01.185878 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-8f3aaa3c-3d9b-4803-9d8e-4dfd53dc38b8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:01.187350 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-8f3aaa3c-3d9b-4803-9d8e-4dfd53dc38b8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:01.190292 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:01.210357 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8f3aaa3c-3d9b-4803-9d8e-4dfd53dc38b8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:01.213276 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8f3aaa3c-3d9b-4803-9d8e-4dfd53dc38b8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:01.216960 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8f3aaa3c-3d9b-4803-9d8e-4dfd53dc38b8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:01.217747 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8f3aaa3c-3d9b-4803-9d8e-4dfd53dc38b8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:01.369885 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-8f3aaa3c-3d9b-4803-9d8e-4dfd53dc38b8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:01.381190 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-8f3aaa3c-3d9b-4803-9d8e-4dfd53dc38b8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 200 len: 1302 microversion: 2.1 time: 0.201099 Jul 14 17:56:01.384558 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 214/501] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:01 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 1302 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:01.592478 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-ec0af2e6-3668-4f7a-98e7-a1b567b94a2d tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:01.593103 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-ec0af2e6-3668-4f7a-98e7-a1b567b94a2d tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:01.607219 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ec0af2e6-3668-4f7a-98e7-a1b567b94a2d tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:01.607994 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ec0af2e6-3668-4f7a-98e7-a1b567b94a2d tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:01.609090 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ec0af2e6-3668-4f7a-98e7-a1b567b94a2d tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:01.609479 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ec0af2e6-3668-4f7a-98e7-a1b567b94a2d tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:01.951085 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-ec0af2e6-3668-4f7a-98e7-a1b567b94a2d tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:01.975496 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-ec0af2e6-3668-4f7a-98e7-a1b567b94a2d tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1260 microversion: 2.1 time: 0.387637 Jul 14 17:56:01.984155 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 288/502] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:01 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1260 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:56:02.411301 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-70f853ab-cedf-4f91-8be7-0f3ea5d698be tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:02.423907 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-70f853ab-cedf-4f91-8be7-0f3ea5d698be tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:02.440750 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-70f853ab-cedf-4f91-8be7-0f3ea5d698be tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:02.441531 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-70f853ab-cedf-4f91-8be7-0f3ea5d698be tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:02.442870 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-70f853ab-cedf-4f91-8be7-0f3ea5d698be tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:02.443595 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-70f853ab-cedf-4f91-8be7-0f3ea5d698be tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:02.662934 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-70f853ab-cedf-4f91-8be7-0f3ea5d698be tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:02.677150 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-70f853ab-cedf-4f91-8be7-0f3ea5d698be tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 200 len: 1370 microversion: 2.1 time: 0.275237 Jul 14 17:56:02.678451 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 215/503] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:02 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 1370 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:03.008337 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-42a4dffc-0d22-4376-b378-260e99e867cc tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:03.010370 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-42a4dffc-0d22-4376-b378-260e99e867cc tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:03.019161 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-42a4dffc-0d22-4376-b378-260e99e867cc tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:03.020195 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-42a4dffc-0d22-4376-b378-260e99e867cc tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:03.021571 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-42a4dffc-0d22-4376-b378-260e99e867cc tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:03.022572 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-42a4dffc-0d22-4376-b378-260e99e867cc tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:03.366012 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-42a4dffc-0d22-4376-b378-260e99e867cc tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:03.414429 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-42a4dffc-0d22-4376-b378-260e99e867cc tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1260 microversion: 2.1 time: 0.411571 Jul 14 17:56:03.427283 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 289/504] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:02 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1260 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:03.707033 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-1eb34611-16c9-4a6e-97ef-e03e36ba8626 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:03.708185 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-1eb34611-16c9-4a6e-97ef-e03e36ba8626 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:03.723659 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1eb34611-16c9-4a6e-97ef-e03e36ba8626 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:03.724181 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1eb34611-16c9-4a6e-97ef-e03e36ba8626 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:03.725009 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1eb34611-16c9-4a6e-97ef-e03e36ba8626 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:03.725456 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1eb34611-16c9-4a6e-97ef-e03e36ba8626 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:03.974613 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-1eb34611-16c9-4a6e-97ef-e03e36ba8626 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:03.995717 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-1eb34611-16c9-4a6e-97ef-e03e36ba8626 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 200 len: 1370 microversion: 2.1 time: 0.287199 Jul 14 17:56:03.997741 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 216/505] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:03 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 1370 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:04.475567 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-757fd2fb-6723-4df2-9b59-ba7a0aab99a1 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:04.481487 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-757fd2fb-6723-4df2-9b59-ba7a0aab99a1 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:04.526110 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-757fd2fb-6723-4df2-9b59-ba7a0aab99a1 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:04.531914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-757fd2fb-6723-4df2-9b59-ba7a0aab99a1 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:04.539711 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-757fd2fb-6723-4df2-9b59-ba7a0aab99a1 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:04.542079 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-757fd2fb-6723-4df2-9b59-ba7a0aab99a1 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:04.650730 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-bb5842d0-45d2-4be8-bb44-3f57fa1df6d1 req-adc0679d-7311-419b-9897-d41278376930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baa9b44b-200c-4ce7-8026-630090c848b6", "tag": "213c9b29-ab9e-4c3a-9f2c-712786e0d8e0"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:56:04.708737 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-bb5842d0-45d2-4be8-bb44-3f57fa1df6d1 req-adc0679d-7311-419b-9897-d41278376930 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:04.717531 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-bb5842d0-45d2-4be8-bb44-3f57fa1df6d1 req-adc0679d-7311-419b-9897-d41278376930 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:04.771380 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-bb5842d0-45d2-4be8-bb44-3f57fa1df6d1 req-adc0679d-7311-419b-9897-d41278376930 service nova] Creating event network-changed:213c9b29-ab9e-4c3a-9f2c-712786e0d8e0 for instance baa9b44b-200c-4ce7-8026-630090c848b6 on hv-cinder-84989 Jul 14 17:56:04.807480 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-bb5842d0-45d2-4be8-bb44-3f57fa1df6d1 req-adc0679d-7311-419b-9897-d41278376930 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164311 Jul 14 17:56:04.816477 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 217/506] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 17:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:56:05.031449 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-2bd7a250-5e9b-40c1-96a3-914d1fb4ddab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:05.037619 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-2bd7a250-5e9b-40c1-96a3-914d1fb4ddab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:05.088957 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2bd7a250-5e9b-40c1-96a3-914d1fb4ddab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:05.089331 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2bd7a250-5e9b-40c1-96a3-914d1fb4ddab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:05.094052 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2bd7a250-5e9b-40c1-96a3-914d1fb4ddab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:05.104934 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2bd7a250-5e9b-40c1-96a3-914d1fb4ddab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:05.347045 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-757fd2fb-6723-4df2-9b59-ba7a0aab99a1 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:05.378268 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-757fd2fb-6723-4df2-9b59-ba7a0aab99a1 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1260 microversion: 2.1 time: 0.913061 Jul 14 17:56:05.386450 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 290/507] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:04 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1260 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:05.755068 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-2bd7a250-5e9b-40c1-96a3-914d1fb4ddab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:05.797417 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-2bd7a250-5e9b-40c1-96a3-914d1fb4ddab tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 200 len: 1370 microversion: 2.1 time: 0.773803 Jul 14 17:56:05.805687 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 218/508] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:05 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 1370 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:06.421893 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-666a47c8-3965-401d-9c45-a3e70f4eacce tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:06.434282 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-666a47c8-3965-401d-9c45-a3e70f4eacce tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:06.454673 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:06.463279 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-666a47c8-3965-401d-9c45-a3e70f4eacce tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:06.464759 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-666a47c8-3965-401d-9c45-a3e70f4eacce tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:06.466733 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-666a47c8-3965-401d-9c45-a3e70f4eacce tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:06.468434 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-666a47c8-3965-401d-9c45-a3e70f4eacce tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:06.809963 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-666a47c8-3965-401d-9c45-a3e70f4eacce tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:06.820115 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-666a47c8-3965-401d-9c45-a3e70f4eacce tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1260 microversion: 2.1 time: 0.415476 Jul 14 17:56:06.821588 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 291/509] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:06 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1260 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:06.832085 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-799660df-1857-4695-aacd-673800a914a5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:06.834446 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-799660df-1857-4695-aacd-673800a914a5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:06.906884 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-799660df-1857-4695-aacd-673800a914a5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:06.912317 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-799660df-1857-4695-aacd-673800a914a5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:06.921129 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-799660df-1857-4695-aacd-673800a914a5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:06.928382 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-799660df-1857-4695-aacd-673800a914a5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:07.236874 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell0:SELECT=2 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:07.265630 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell0:SELECT=12 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:07.302995 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-799660df-1857-4695-aacd-673800a914a5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:07.325462 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-799660df-1857-4695-aacd-673800a914a5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 200 len: 1370 microversion: 2.1 time: 0.504735 Jul 14 17:56:07.326387 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 219/510] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:06 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 1370 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:07.858658 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-3317ca47-b7a3-4927-a67c-5843113481e1 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:07.860525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-3317ca47-b7a3-4927-a67c-5843113481e1 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:07.893611 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell0:SELECT=8 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:07.897222 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3317ca47-b7a3-4927-a67c-5843113481e1 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:07.901954 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3317ca47-b7a3-4927-a67c-5843113481e1 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:07.903443 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3317ca47-b7a3-4927-a67c-5843113481e1 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:07.910104 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3317ca47-b7a3-4927-a67c-5843113481e1 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:08.345413 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-a87631f8-d258-4ece-a87a-148faa0b6df9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:08.346890 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-a87631f8-d258-4ece-a87a-148faa0b6df9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:08.352852 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-3317ca47-b7a3-4927-a67c-5843113481e1 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:08.368511 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-3317ca47-b7a3-4927-a67c-5843113481e1 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1260 microversion: 2.1 time: 0.520958 Jul 14 17:56:08.383967 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 292/511] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:07 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1260 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:08.384275 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a87631f8-d258-4ece-a87a-148faa0b6df9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:08.384275 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a87631f8-d258-4ece-a87a-148faa0b6df9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:08.394704 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a87631f8-d258-4ece-a87a-148faa0b6df9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:08.395139 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a87631f8-d258-4ece-a87a-148faa0b6df9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:08.762124 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-a87631f8-d258-4ece-a87a-148faa0b6df9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:08.777100 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-a87631f8-d258-4ece-a87a-148faa0b6df9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 200 len: 1370 microversion: 2.1 time: 0.436153 Jul 14 17:56:08.778723 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 220/512] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:08 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 1370 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:56:09.403226 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-2e4c0c30-c8e1-42bc-9598-949fb5d4a501 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:09.404633 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-2e4c0c30-c8e1-42bc-9598-949fb5d4a501 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:09.430068 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2e4c0c30-c8e1-42bc-9598-949fb5d4a501 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:09.436517 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2e4c0c30-c8e1-42bc-9598-949fb5d4a501 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:09.437772 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2e4c0c30-c8e1-42bc-9598-949fb5d4a501 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:09.438473 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2e4c0c30-c8e1-42bc-9598-949fb5d4a501 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:09.442030 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=1 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:09.734550 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-2e4c0c30-c8e1-42bc-9598-949fb5d4a501 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:09.749142 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-2e4c0c30-c8e1-42bc-9598-949fb5d4a501 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1260 microversion: 2.1 time: 0.346491 Jul 14 17:56:09.750456 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 293/513] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:09 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1260 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:09.797352 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-378a988b-d1b3-4de0-a233-eea3134cab5e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:09.798874 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-378a988b-d1b3-4de0-a233-eea3134cab5e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:09.821106 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-378a988b-d1b3-4de0-a233-eea3134cab5e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:09.824212 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-378a988b-d1b3-4de0-a233-eea3134cab5e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:09.826883 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-378a988b-d1b3-4de0-a233-eea3134cab5e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:09.828404 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-378a988b-d1b3-4de0-a233-eea3134cab5e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:10.308602 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-378a988b-d1b3-4de0-a233-eea3134cab5e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:10.317914 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-378a988b-d1b3-4de0-a233-eea3134cab5e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 200 len: 1370 microversion: 2.1 time: 0.526337 Jul 14 17:56:10.319254 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 221/514] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:09 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 1370 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:10.772854 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-2843149f-c7b0-43df-8edb-a1b49551c82f tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:10.775275 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-2843149f-c7b0-43df-8edb-a1b49551c82f tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:10.787116 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2843149f-c7b0-43df-8edb-a1b49551c82f tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:10.788784 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2843149f-c7b0-43df-8edb-a1b49551c82f tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:10.791217 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2843149f-c7b0-43df-8edb-a1b49551c82f tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:10.792475 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2843149f-c7b0-43df-8edb-a1b49551c82f tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:11.053948 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-2843149f-c7b0-43df-8edb-a1b49551c82f tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:11.070765 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-2843149f-c7b0-43df-8edb-a1b49551c82f tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1260 microversion: 2.1 time: 0.306565 Jul 14 17:56:11.071536 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 294/515] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:10 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1260 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:11.339783 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-d3f86ec4-624b-477c-a4fe-a69ff07a1710 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:11.341989 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-d3f86ec4-624b-477c-a4fe-a69ff07a1710 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:11.380996 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d3f86ec4-624b-477c-a4fe-a69ff07a1710 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:11.382217 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d3f86ec4-624b-477c-a4fe-a69ff07a1710 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:11.383908 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d3f86ec4-624b-477c-a4fe-a69ff07a1710 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:11.385597 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d3f86ec4-624b-477c-a4fe-a69ff07a1710 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:11.778459 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-d3f86ec4-624b-477c-a4fe-a69ff07a1710 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:11.804792 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-d3f86ec4-624b-477c-a4fe-a69ff07a1710 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 200 len: 1370 microversion: 2.1 time: 0.472068 Jul 14 17:56:11.820434 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 222/516] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:11 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 1370 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:56:12.021298 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [req-1d295a22-ca94-4943-9cb9-b9de48026fc0 req-8032af23-7e9e-4132-9d49-c9f8c0fcb47a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baa9b44b-200c-4ce7-8026-630090c848b6", "name": "network-vif-plugged", "status": "completed", "tag": "213c9b29-ab9e-4c3a-9f2c-712786e0d8e0"}]} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:56:12.038593 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-1d295a22-ca94-4943-9cb9-b9de48026fc0 req-8032af23-7e9e-4132-9d49-c9f8c0fcb47a service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:12.039041 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-1d295a22-ca94-4943-9cb9-b9de48026fc0 req-8032af23-7e9e-4132-9d49-c9f8c0fcb47a service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:12.215330 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.compute.server_external_events [req-1d295a22-ca94-4943-9cb9-b9de48026fc0 req-8032af23-7e9e-4132-9d49-c9f8c0fcb47a service nova] Creating event network-vif-plugged:213c9b29-ab9e-4c3a-9f2c-712786e0d8e0 for instance baa9b44b-200c-4ce7-8026-630090c848b6 on hv-cinder-84989 Jul 14 17:56:12.215330 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [req-1d295a22-ca94-4943-9cb9-b9de48026fc0 req-8032af23-7e9e-4132-9d49-c9f8c0fcb47a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091043 Jul 14 17:56:12.216085 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-a148c00d-2689-4024-b56f-f075b6dce508 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:12.216085 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-a148c00d-2689-4024-b56f-f075b6dce508 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:12.216085 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a148c00d-2689-4024-b56f-f075b6dce508 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:12.216085 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a148c00d-2689-4024-b56f-f075b6dce508 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:12.216395 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 295/517] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 17:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:56:12.216486 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a148c00d-2689-4024-b56f-f075b6dce508 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:12.216486 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a148c00d-2689-4024-b56f-f075b6dce508 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:12.713502 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-a148c00d-2689-4024-b56f-f075b6dce508 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:12.727139 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-a148c00d-2689-4024-b56f-f075b6dce508 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1260 microversion: 2.1 time: 0.555196 Jul 14 17:56:12.729874 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 223/518] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:12 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1260 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:12.831617 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-077342dc-94ba-44e6-8a20-af21f911c2e5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:12.832752 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-077342dc-94ba-44e6-8a20-af21f911c2e5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:12.865131 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-077342dc-94ba-44e6-8a20-af21f911c2e5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:12.865953 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-077342dc-94ba-44e6-8a20-af21f911c2e5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:12.868287 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-077342dc-94ba-44e6-8a20-af21f911c2e5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:12.870272 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-077342dc-94ba-44e6-8a20-af21f911c2e5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:13.156360 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-077342dc-94ba-44e6-8a20-af21f911c2e5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:13.166103 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-077342dc-94ba-44e6-8a20-af21f911c2e5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 200 len: 1370 microversion: 2.1 time: 0.338942 Jul 14 17:56:13.182617 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 296/519] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:12 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 1370 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:13.745844 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-1752018c-090f-4000-96ac-5d2994ab1fbf tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:13.746741 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-1752018c-090f-4000-96ac-5d2994ab1fbf tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:13.766898 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1752018c-090f-4000-96ac-5d2994ab1fbf tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:13.767352 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1752018c-090f-4000-96ac-5d2994ab1fbf tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:13.768808 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1752018c-090f-4000-96ac-5d2994ab1fbf tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:13.769443 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1752018c-090f-4000-96ac-5d2994ab1fbf tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:14.144418 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-1752018c-090f-4000-96ac-5d2994ab1fbf tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:14.159897 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-1752018c-090f-4000-96ac-5d2994ab1fbf tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1260 microversion: 2.1 time: 0.418499 Jul 14 17:56:14.173570 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 224/520] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:13 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1260 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:56:14.190648 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-18003ce5-e0fe-4288-8665-1ed436c32652 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:14.191536 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-18003ce5-e0fe-4288-8665-1ed436c32652 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:14.201444 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-18003ce5-e0fe-4288-8665-1ed436c32652 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:14.202352 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-18003ce5-e0fe-4288-8665-1ed436c32652 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:14.203384 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-18003ce5-e0fe-4288-8665-1ed436c32652 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:14.204262 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-18003ce5-e0fe-4288-8665-1ed436c32652 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:14.467865 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-18003ce5-e0fe-4288-8665-1ed436c32652 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:14.484470 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-18003ce5-e0fe-4288-8665-1ed436c32652 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 200 len: 1370 microversion: 2.1 time: 0.297711 Jul 14 17:56:14.493138 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 297/521] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:14 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 1370 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:15.199959 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-70636dbc-0614-4ba6-af46-7ad85b1a819f tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:15.201509 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-70636dbc-0614-4ba6-af46-7ad85b1a819f tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:15.219451 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-70636dbc-0614-4ba6-af46-7ad85b1a819f tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:15.220601 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-70636dbc-0614-4ba6-af46-7ad85b1a819f tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:15.222814 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-70636dbc-0614-4ba6-af46-7ad85b1a819f tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:15.223575 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-70636dbc-0614-4ba6-af46-7ad85b1a819f tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:15.512895 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-70636dbc-0614-4ba6-af46-7ad85b1a819f tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:15.521026 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-db57a7f3-b9a1-4034-9487-5ebe50bf6a65 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:15.521646 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-db57a7f3-b9a1-4034-9487-5ebe50bf6a65 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:15.524340 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-70636dbc-0614-4ba6-af46-7ad85b1a819f tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1260 microversion: 2.1 time: 0.335308 Jul 14 17:56:15.527455 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 225/522] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:15 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1260 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:15.530252 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-db57a7f3-b9a1-4034-9487-5ebe50bf6a65 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:15.530989 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-db57a7f3-b9a1-4034-9487-5ebe50bf6a65 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:15.532529 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-db57a7f3-b9a1-4034-9487-5ebe50bf6a65 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:15.533215 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-db57a7f3-b9a1-4034-9487-5ebe50bf6a65 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:15.707426 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-db57a7f3-b9a1-4034-9487-5ebe50bf6a65 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:15.716939 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-db57a7f3-b9a1-4034-9487-5ebe50bf6a65 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 200 len: 1370 microversion: 2.1 time: 0.199802 Jul 14 17:56:15.729940 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 298/523] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:15 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 1370 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:16.558716 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-aa456469-0d6e-4e44-928f-2233500e8e56 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:16.558716 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-aa456469-0d6e-4e44-928f-2233500e8e56 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:16.660712 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-aa456469-0d6e-4e44-928f-2233500e8e56 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:16.660712 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-aa456469-0d6e-4e44-928f-2233500e8e56 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:16.660712 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-aa456469-0d6e-4e44-928f-2233500e8e56 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:16.660712 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-aa456469-0d6e-4e44-928f-2233500e8e56 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:16.737813 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-6fbd9b63-9a2b-4f61-87d2-03e6d259e479 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:16.739286 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-6fbd9b63-9a2b-4f61-87d2-03e6d259e479 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:16.761876 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6fbd9b63-9a2b-4f61-87d2-03e6d259e479 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:16.786863 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6fbd9b63-9a2b-4f61-87d2-03e6d259e479 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:16.790195 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6fbd9b63-9a2b-4f61-87d2-03e6d259e479 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:16.800773 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6fbd9b63-9a2b-4f61-87d2-03e6d259e479 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:17.089361 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-6fbd9b63-9a2b-4f61-87d2-03e6d259e479 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:17.108707 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-6fbd9b63-9a2b-4f61-87d2-03e6d259e479 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 200 len: 1563 microversion: 2.1 time: 0.374994 Jul 14 17:56:17.122580 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 299/524] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:16 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 1563 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:17.128255 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [req-ee8cad27-1d0a-4864-87da-b2950dc2d65c req-08f1142e-e6d4-46f9-bf71-e051074f0d4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28947673-5bde-4923-9e70-bec5086fe9c6", "name": "network-vif-plugged", "status": "completed", "tag": "2f38f011-fe4c-4851-b4df-370ae6045e1f"}]} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:56:17.129503 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-aa456469-0d6e-4e44-928f-2233500e8e56 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:17.135388 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-ee8cad27-1d0a-4864-87da-b2950dc2d65c req-08f1142e-e6d4-46f9-bf71-e051074f0d4b service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:17.135840 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-ee8cad27-1d0a-4864-87da-b2950dc2d65c req-08f1142e-e6d4-46f9-bf71-e051074f0d4b service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:17.146094 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-aa456469-0d6e-4e44-928f-2233500e8e56 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1260 microversion: 2.1 time: 0.594296 Jul 14 17:56:17.147085 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 226/525] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:16 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1260 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:17.154689 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-ee60cee4-f687-4575-95f5-c77ffe0068a7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:17.156395 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-ee60cee4-f687-4575-95f5-c77ffe0068a7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:17.159244 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.compute.server_external_events [req-ee8cad27-1d0a-4864-87da-b2950dc2d65c req-08f1142e-e6d4-46f9-bf71-e051074f0d4b service nova] Creating event network-vif-plugged:2f38f011-fe4c-4851-b4df-370ae6045e1f for instance 28947673-5bde-4923-9e70-bec5086fe9c6 on hv-cinder-84989 Jul 14 17:56:17.174114 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ee60cee4-f687-4575-95f5-c77ffe0068a7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:17.174733 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ee60cee4-f687-4575-95f5-c77ffe0068a7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:17.175827 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ee60cee4-f687-4575-95f5-c77ffe0068a7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:17.176463 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ee60cee4-f687-4575-95f5-c77ffe0068a7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:17.189783 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [req-ee8cad27-1d0a-4864-87da-b2950dc2d65c req-08f1142e-e6d4-46f9-bf71-e051074f0d4b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071174 Jul 14 17:56:17.191215 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 300/526] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 17:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:56:17.344868 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-ee60cee4-f687-4575-95f5-c77ffe0068a7 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.196537 Jul 14 17:56:17.351987 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 227/527] 10.222.0.64 () {58 vars in 1274 bytes} [Thu Jul 14 17:56:17 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6/os-interface => generated 284 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:56:18.200730 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-54a46531-4ef2-4e68-bf85-33899768a242 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:18.200730 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-54a46531-4ef2-4e68-bf85-33899768a242 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:18.200730 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-54a46531-4ef2-4e68-bf85-33899768a242 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:18.200730 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-54a46531-4ef2-4e68-bf85-33899768a242 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:18.201388 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-54a46531-4ef2-4e68-bf85-33899768a242 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:18.201388 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-54a46531-4ef2-4e68-bf85-33899768a242 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:18.482886 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-54a46531-4ef2-4e68-bf85-33899768a242 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:18.495653 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-54a46531-4ef2-4e68-bf85-33899768a242 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1260 microversion: 2.1 time: 0.333753 Jul 14 17:56:18.508341 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 301/528] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:18 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1260 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:19.004986 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-8d81ebf7-deb4-4333-bbcc-a7634dcaa11e tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Action: 'create', calling method: .version_select at 0x7f1380177c10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1189023489", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMj7zIqZfJHs+dL0M/IMU0YoMwEnzlfnD4+VUUvK9doy8Szmg5aJWgIQxRNyp8WvmY5++VFh2oHxvIdGLmCZSbZnZQYUoc0KjDRUW4gGZlzHAObC149XPrSxQLS2CW6aaA=="}} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:56:19.042976 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.quota [None req-8d81ebf7-deb4-4333-bbcc-a7634dcaa11e tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Getting quotas for project fa36825e7c014d48a7fe9375d9abdf7d. Resources: {'key_pairs'} {{(pid=129470) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 17:56:19.053342 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.quota [None req-8d81ebf7-deb4-4333-bbcc-a7634dcaa11e tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Getting quotas for user 3e3fd98743554b0a8bf1cea0523ed4ae and project fa36825e7c014d48a7fe9375d9abdf7d. Resources: {'key_pairs'} {{(pid=129470) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 17:56:19.132511 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-8d81ebf7-deb4-4333-bbcc-a7634dcaa11e tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.131538 Jul 14 17:56:19.134613 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 228/529] 10.222.0.64 () {60 vars in 1158 bytes} [Thu Jul 14 17:56:18 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:56:19.230762 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-fa0cb345-cecb-4e78-98af-587b26f0d06e req-f6568336-6156-4e01-bfed-20c1ecb768ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baa9b44b-200c-4ce7-8026-630090c848b6", "tag": "213c9b29-ab9e-4c3a-9f2c-712786e0d8e0"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:56:19.235182 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-d181d937-4e9d-4190-a6db-2f2319cf93d4 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-658885632", "imageRef": "9e048943-62c9-4b10-8b72-9af301dc6ab5", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1189023489", "networks": [{"uuid": "27465d3e-8e1f-4206-8414-052c23128bcd"}]}} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:56:19.250350 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-fa0cb345-cecb-4e78-98af-587b26f0d06e req-f6568336-6156-4e01-bfed-20c1ecb768ab service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:19.252047 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-fa0cb345-cecb-4e78-98af-587b26f0d06e req-f6568336-6156-4e01-bfed-20c1ecb768ab service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:19.268644 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-fa0cb345-cecb-4e78-98af-587b26f0d06e req-f6568336-6156-4e01-bfed-20c1ecb768ab service nova] Creating event network-changed:213c9b29-ab9e-4c3a-9f2c-712786e0d8e0 for instance baa9b44b-200c-4ce7-8026-630090c848b6 on hv-cinder-84989 Jul 14 17:56:19.285145 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-fa0cb345-cecb-4e78-98af-587b26f0d06e req-f6568336-6156-4e01-bfed-20c1ecb768ab service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059289 Jul 14 17:56:19.288914 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 229/530] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 17:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:56:19.424132 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.network.neutron [None req-d181d937-4e9d-4190-a6db-2f2319cf93d4 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] validate_networks() for [('27465d3e-8e1f-4206-8414-052c23128bcd', None, None, None, None, None)] {{(pid=129471) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 17:56:19.518536 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-b037f189-c625-4548-801e-6773073587a8 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:19.519764 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-b037f189-c625-4548-801e-6773073587a8 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:19.546844 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b037f189-c625-4548-801e-6773073587a8 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:19.547142 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b037f189-c625-4548-801e-6773073587a8 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:19.550323 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b037f189-c625-4548-801e-6773073587a8 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:19.551751 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b037f189-c625-4548-801e-6773073587a8 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:19.616814 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=100 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:19.927730 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-b037f189-c625-4548-801e-6773073587a8 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:19.936814 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-b037f189-c625-4548-801e-6773073587a8 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1260 microversion: 2.1 time: 0.425167 Jul 14 17:56:19.944144 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 230/531] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:19 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1260 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:20.283488 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-d181d937-4e9d-4190-a6db-2f2319cf93d4 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Flavor limits 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 17:56:20.284807 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-d181d937-4e9d-4190-a6db-2f2319cf93d4 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Image limits 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 17:56:20.285853 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-d181d937-4e9d-4190-a6db-2f2319cf93d4 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Flavor pref 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 17:56:20.286918 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-d181d937-4e9d-4190-a6db-2f2319cf93d4 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Image pref 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 17:56:20.287396 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-d181d937-4e9d-4190-a6db-2f2319cf93d4 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 17:56:20.302134 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d181d937-4e9d-4190-a6db-2f2319cf93d4 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:20.302947 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d181d937-4e9d-4190-a6db-2f2319cf93d4 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:20.304473 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d181d937-4e9d-4190-a6db-2f2319cf93d4 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:20.305264 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d181d937-4e9d-4190-a6db-2f2319cf93d4 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:20.341452 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.quota [None req-d181d937-4e9d-4190-a6db-2f2319cf93d4 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Getting quotas for project fa36825e7c014d48a7fe9375d9abdf7d. Resources: {'ram', 'cores', 'instances'} {{(pid=129471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 17:56:20.349434 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.quota [None req-d181d937-4e9d-4190-a6db-2f2319cf93d4 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Getting quotas for user 3e3fd98743554b0a8bf1cea0523ed4ae and project fa36825e7c014d48a7fe9375d9abdf7d. Resources: {'ram', 'cores', 'instances'} {{(pid=129471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 17:56:20.370977 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-d181d937-4e9d-4190-a6db-2f2319cf93d4 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Going to run 1 instances... {{(pid=129471) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 17:56:20.375142 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-d181d937-4e9d-4190-a6db-2f2319cf93d4 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e048943-62c9-4b10-8b72-9af301dc6ab5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 17:56:20.448383 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-d181d937-4e9d-4190-a6db-2f2319cf93d4 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.232245 Jul 14 17:56:20.449892 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 302/532] 10.222.0.64 () {60 vars in 1146 bytes} [Thu Jul 14 17:56:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1235 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 17:56:20.464843 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-0553fe07-cb05-44ae-89f0-afa20114ccef tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:20.466117 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-0553fe07-cb05-44ae-89f0-afa20114ccef tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:20.569971 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-0553fe07-cb05-44ae-89f0-afa20114ccef tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:20.583393 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-0553fe07-cb05-44ae-89f0-afa20114ccef tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1258 microversion: 2.1 time: 0.123112 Jul 14 17:56:20.586466 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 231/533] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:20 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1258 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:20.977796 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-9570dd45-cf60-4b97-b4dc-4059efe72dc0 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:20.979668 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-9570dd45-cf60-4b97-b4dc-4059efe72dc0 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:21.006369 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9570dd45-cf60-4b97-b4dc-4059efe72dc0 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:21.007399 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9570dd45-cf60-4b97-b4dc-4059efe72dc0 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:21.008897 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9570dd45-cf60-4b97-b4dc-4059efe72dc0 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:21.009649 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9570dd45-cf60-4b97-b4dc-4059efe72dc0 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:21.313523 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-9570dd45-cf60-4b97-b4dc-4059efe72dc0 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:21.344143 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-9570dd45-cf60-4b97-b4dc-4059efe72dc0 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1444 microversion: 2.1 time: 0.374132 Jul 14 17:56:21.347413 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 303/534] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:20 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1444 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:56:21.375607 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-fe6c4fc2-37e8-4682-8938-9044e4d3b73f tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:21.376350 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-fe6c4fc2-37e8-4682-8938-9044e4d3b73f tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:21.383093 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fe6c4fc2-37e8-4682-8938-9044e4d3b73f tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:21.383578 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fe6c4fc2-37e8-4682-8938-9044e4d3b73f tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:21.384434 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fe6c4fc2-37e8-4682-8938-9044e4d3b73f tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:21.384906 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fe6c4fc2-37e8-4682-8938-9044e4d3b73f tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:21.576963 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-fe6c4fc2-37e8-4682-8938-9044e4d3b73f tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:21.592755 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-fe6c4fc2-37e8-4682-8938-9044e4d3b73f tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1444 microversion: 2.1 time: 0.221452 Jul 14 17:56:21.593976 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 232/535] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:21 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1444 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:21.615795 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-11da6c71-69d2-4169-8f05-5524876e3f1d tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:21.618374 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-11da6c71-69d2-4169-8f05-5524876e3f1d tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:21.629480 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-11da6c71-69d2-4169-8f05-5524876e3f1d tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:21.630263 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-11da6c71-69d2-4169-8f05-5524876e3f1d tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:21.631806 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-11da6c71-69d2-4169-8f05-5524876e3f1d tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:21.632653 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-11da6c71-69d2-4169-8f05-5524876e3f1d tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:21.741894 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-11da6c71-69d2-4169-8f05-5524876e3f1d tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:21.755387 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-11da6c71-69d2-4169-8f05-5524876e3f1d tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1310 microversion: 2.1 time: 0.146075 Jul 14 17:56:21.763792 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 304/536] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:21 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1310 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:22.790849 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-93bbebec-854d-413b-82b7-feb9f20cdab2 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:22.799648 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-93bbebec-854d-413b-82b7-feb9f20cdab2 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:22.814981 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-93bbebec-854d-413b-82b7-feb9f20cdab2 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:22.816540 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-93bbebec-854d-413b-82b7-feb9f20cdab2 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:22.818258 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-93bbebec-854d-413b-82b7-feb9f20cdab2 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:22.819312 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-93bbebec-854d-413b-82b7-feb9f20cdab2 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:23.037529 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-93bbebec-854d-413b-82b7-feb9f20cdab2 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:23.056271 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-93bbebec-854d-413b-82b7-feb9f20cdab2 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1316 microversion: 2.1 time: 0.276212 Jul 14 17:56:23.064062 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 233/537] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:22 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1316 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:24.080223 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-9118e8c9-dcdb-48f6-b59d-d47fead72fef tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:24.081201 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-9118e8c9-dcdb-48f6-b59d-d47fead72fef tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:24.091446 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9118e8c9-dcdb-48f6-b59d-d47fead72fef tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:24.092183 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9118e8c9-dcdb-48f6-b59d-d47fead72fef tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:24.093107 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9118e8c9-dcdb-48f6-b59d-d47fead72fef tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:24.093603 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9118e8c9-dcdb-48f6-b59d-d47fead72fef tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:24.494736 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-9118e8c9-dcdb-48f6-b59d-d47fead72fef tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:24.505554 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-9118e8c9-dcdb-48f6-b59d-d47fead72fef tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1358 microversion: 2.1 time: 0.428890 Jul 14 17:56:24.506176 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 305/538] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:24 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1358 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:56:25.533899 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-8b0ad23a-1166-4bba-94a4-14fbd20595de tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:25.537207 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-8b0ad23a-1166-4bba-94a4-14fbd20595de tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:25.546400 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8b0ad23a-1166-4bba-94a4-14fbd20595de tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:25.546615 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8b0ad23a-1166-4bba-94a4-14fbd20595de tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:25.548474 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8b0ad23a-1166-4bba-94a4-14fbd20595de tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:25.549187 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8b0ad23a-1166-4bba-94a4-14fbd20595de tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:25.690299 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [req-28ec664a-6108-4371-ae48-c53bf83afb82 req-7cbb86a8-d624-413c-a1ca-27a6280b54e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28947673-5bde-4923-9e70-bec5086fe9c6", "tag": "2f38f011-fe4c-4851-b4df-370ae6045e1f"}]} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:56:25.710299 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-28ec664a-6108-4371-ae48-c53bf83afb82 req-7cbb86a8-d624-413c-a1ca-27a6280b54e6 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:25.710947 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-28ec664a-6108-4371-ae48-c53bf83afb82 req-7cbb86a8-d624-413c-a1ca-27a6280b54e6 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:25.743597 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.compute.server_external_events [req-28ec664a-6108-4371-ae48-c53bf83afb82 req-7cbb86a8-d624-413c-a1ca-27a6280b54e6 service nova] Creating event network-changed:2f38f011-fe4c-4851-b4df-370ae6045e1f for instance 28947673-5bde-4923-9e70-bec5086fe9c6 on hv-cinder-84989 Jul 14 17:56:25.755649 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [req-28ec664a-6108-4371-ae48-c53bf83afb82 req-7cbb86a8-d624-413c-a1ca-27a6280b54e6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078783 Jul 14 17:56:25.758678 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 306/539] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 17:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 17:56:25.937663 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-8b0ad23a-1166-4bba-94a4-14fbd20595de tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:25.961252 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-8b0ad23a-1166-4bba-94a4-14fbd20595de tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1358 microversion: 2.1 time: 0.432259 Jul 14 17:56:25.967347 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 234/540] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:25 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1358 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:26.269039 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-eabf05b2-d05e-43fe-b7ba-e391d6fd81b8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:26.270054 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-eabf05b2-d05e-43fe-b7ba-e391d6fd81b8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:26.294627 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-eabf05b2-d05e-43fe-b7ba-e391d6fd81b8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:26.295603 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-eabf05b2-d05e-43fe-b7ba-e391d6fd81b8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:26.297193 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-eabf05b2-d05e-43fe-b7ba-e391d6fd81b8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:26.303116 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-eabf05b2-d05e-43fe-b7ba-e391d6fd81b8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:26.376404 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-eabf05b2-d05e-43fe-b7ba-e391d6fd81b8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba/ips" status: 200 len: 145 microversion: 2.1 time: 0.124607 Jul 14 17:56:26.386024 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 307/541] 10.222.0.64 () {58 vars in 1247 bytes} [Thu Jul 14 17:56:26 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba/ips => generated 145 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:56:26.999256 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-cc4302b9-66ff-4703-8c44-48af6aeed172 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:27.009278 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-cc4302b9-66ff-4703-8c44-48af6aeed172 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:27.033708 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-cc4302b9-66ff-4703-8c44-48af6aeed172 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:27.034271 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-cc4302b9-66ff-4703-8c44-48af6aeed172 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:27.035361 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-cc4302b9-66ff-4703-8c44-48af6aeed172 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:27.035724 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-cc4302b9-66ff-4703-8c44-48af6aeed172 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:27.271607 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-cc4302b9-66ff-4703-8c44-48af6aeed172 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:27.300402 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-cc4302b9-66ff-4703-8c44-48af6aeed172 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1358 microversion: 2.1 time: 0.308278 Jul 14 17:56:27.301217 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 235/542] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:26 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1358 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:28.325659 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-757bc0f0-26a0-4764-a05b-f0dba62ad166 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:28.326319 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-757bc0f0-26a0-4764-a05b-f0dba62ad166 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:28.332961 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-757bc0f0-26a0-4764-a05b-f0dba62ad166 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:28.333417 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-757bc0f0-26a0-4764-a05b-f0dba62ad166 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:28.334257 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-757bc0f0-26a0-4764-a05b-f0dba62ad166 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:28.334701 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-757bc0f0-26a0-4764-a05b-f0dba62ad166 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:28.609277 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-757bc0f0-26a0-4764-a05b-f0dba62ad166 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:28.623275 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-757bc0f0-26a0-4764-a05b-f0dba62ad166 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1358 microversion: 2.1 time: 0.301989 Jul 14 17:56:28.624530 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 308/543] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:28 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1358 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:56:28.987973 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-0674e1d2-597d-4a00-9e97-13eecac2322c tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1762209841", "imageRef": "cf1f5d8c-9e49-4272-8e19-8e3c587056e1", "flavorRef": "452"}} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:56:29.086477 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.network.neutron [None req-0674e1d2-597d-4a00-9e97-13eecac2322c tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] validate_networks() for None {{(pid=129470) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 17:56:29.421790 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-0674e1d2-597d-4a00-9e97-13eecac2322c tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Flavor limits 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 17:56:29.422261 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-0674e1d2-597d-4a00-9e97-13eecac2322c tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Image limits 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 17:56:29.422795 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-0674e1d2-597d-4a00-9e97-13eecac2322c tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Flavor pref 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 17:56:29.423352 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-0674e1d2-597d-4a00-9e97-13eecac2322c tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Image pref 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 17:56:29.423811 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-0674e1d2-597d-4a00-9e97-13eecac2322c tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 17:56:29.435225 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0674e1d2-597d-4a00-9e97-13eecac2322c tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:29.435674 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0674e1d2-597d-4a00-9e97-13eecac2322c tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:29.436538 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0674e1d2-597d-4a00-9e97-13eecac2322c tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:29.436978 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0674e1d2-597d-4a00-9e97-13eecac2322c tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:29.457151 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.quota [None req-0674e1d2-597d-4a00-9e97-13eecac2322c tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Getting quotas for project 052d2b0826d04dd895c3621cf6d87e17. Resources: {'ram', 'cores', 'instances'} {{(pid=129470) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 17:56:29.463317 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.quota [None req-0674e1d2-597d-4a00-9e97-13eecac2322c tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Getting quotas for user 353609092f9b4a378478169ad8b90503 and project 052d2b0826d04dd895c3621cf6d87e17. Resources: {'ram', 'cores', 'instances'} {{(pid=129470) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 17:56:29.477341 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-0674e1d2-597d-4a00-9e97-13eecac2322c tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Going to run 1 instances... {{(pid=129470) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 17:56:29.479788 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-0674e1d2-597d-4a00-9e97-13eecac2322c tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] [instance: 717f56d8-6ef5-45b6-8768-96c7a1efc733] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf1f5d8c-9e49-4272-8e19-8e3c587056e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129470) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 17:56:29.543544 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-0674e1d2-597d-4a00-9e97-13eecac2322c tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.563136 Jul 14 17:56:29.545684 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 236/544] 10.222.0.64 () {60 vars in 1146 bytes} [Thu Jul 14 17:56:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 17:56:29.572188 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-45fe612d-291b-4b78-a499-8cf4c513662b tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:29.581523 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-45fe612d-291b-4b78-a499-8cf4c513662b tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] [instance: 717f56d8-6ef5-45b6-8768-96c7a1efc733] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:29.650945 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-fe0387e9-91a4-49a3-b029-ec6d0b65851b tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:29.650945 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-fe0387e9-91a4-49a3-b029-ec6d0b65851b tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:29.675219 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fe0387e9-91a4-49a3-b029-ec6d0b65851b tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:29.676074 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fe0387e9-91a4-49a3-b029-ec6d0b65851b tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:29.677346 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fe0387e9-91a4-49a3-b029-ec6d0b65851b tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:29.678482 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fe0387e9-91a4-49a3-b029-ec6d0b65851b tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:30.023565 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-45fe612d-291b-4b78-a499-8cf4c513662b tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353609092f9b4a378478169ad8b90503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052d2b0826d04dd895c3621cf6d87e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:30.047293 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-45fe612d-291b-4b78-a499-8cf4c513662b tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] 10.222.0.64 "GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733" status: 200 len: 1215 microversion: 2.1 time: 0.495628 Jul 14 17:56:30.049049 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 309/545] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:29 2022] GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733 => generated 1215 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:30.220572 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-fe0387e9-91a4-49a3-b029-ec6d0b65851b tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:30.232611 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-fe0387e9-91a4-49a3-b029-ec6d0b65851b tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1358 microversion: 2.1 time: 0.592266 Jul 14 17:56:30.236029 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 237/546] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:29 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1358 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:30.316744 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-75a6c693-d47b-4a88-9d3c-e60b8a0d9ecf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:30.320900 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-75a6c693-d47b-4a88-9d3c-e60b8a0d9ecf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:30.330331 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell0:SELECT=2 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:30.343057 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-75a6c693-d47b-4a88-9d3c-e60b8a0d9ecf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:30.343863 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-75a6c693-d47b-4a88-9d3c-e60b8a0d9ecf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:30.349732 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-75a6c693-d47b-4a88-9d3c-e60b8a0d9ecf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:30.350540 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-75a6c693-d47b-4a88-9d3c-e60b8a0d9ecf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:30.408722 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-75a6c693-d47b-4a88-9d3c-e60b8a0d9ecf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17/ips" status: 200 len: 153 microversion: 2.20 time: 0.104764 Jul 14 17:56:30.412803 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 310/547] 10.222.0.64 () {60 vars in 1288 bytes} [Thu Jul 14 17:56:30 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17/ips => generated 153 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 17:56:31.086779 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-e6188792-291d-4c62-b862-a9ae9c1065aa tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:31.087399 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-e6188792-291d-4c62-b862-a9ae9c1065aa tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] [instance: 717f56d8-6ef5-45b6-8768-96c7a1efc733] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:31.095079 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e6188792-291d-4c62-b862-a9ae9c1065aa tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:31.095538 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e6188792-291d-4c62-b862-a9ae9c1065aa tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:31.096363 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e6188792-291d-4c62-b862-a9ae9c1065aa tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:31.096806 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e6188792-291d-4c62-b862-a9ae9c1065aa tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:31.136982 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-e9bfd6dd-84df-4c59-9c11-b3c1a8b6bee6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3933978e-abcb-425b-aa40-1397e2ec448a"}} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:56:31.138122 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-e9bfd6dd-84df-4c59-9c11-b3c1a8b6bee6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:31.144814 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e9bfd6dd-84df-4c59-9c11-b3c1a8b6bee6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:31.145554 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e9bfd6dd-84df-4c59-9c11-b3c1a8b6bee6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:31.146520 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e9bfd6dd-84df-4c59-9c11-b3c1a8b6bee6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:31.147137 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e9bfd6dd-84df-4c59-9c11-b3c1a8b6bee6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:31.168624 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-e6188792-291d-4c62-b862-a9ae9c1065aa tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353609092f9b4a378478169ad8b90503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052d2b0826d04dd895c3621cf6d87e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:31.176413 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-e6188792-291d-4c62-b862-a9ae9c1065aa tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] 10.222.0.64 "GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733" status: 200 len: 1219 microversion: 2.1 time: 0.093667 Jul 14 17:56:31.177811 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 238/548] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:31 2022] GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:31.259276 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-82b7c8a1-c97a-4dd1-95ea-df214425a015 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:31.261100 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-82b7c8a1-c97a-4dd1-95ea-df214425a015 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:31.262642 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:31.269308 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-82b7c8a1-c97a-4dd1-95ea-df214425a015 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:31.270093 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-82b7c8a1-c97a-4dd1-95ea-df214425a015 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:31.271102 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-82b7c8a1-c97a-4dd1-95ea-df214425a015 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:31.271751 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-82b7c8a1-c97a-4dd1-95ea-df214425a015 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:31.423241 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-82b7c8a1-c97a-4dd1-95ea-df214425a015 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:31.430654 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-82b7c8a1-c97a-4dd1-95ea-df214425a015 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1358 microversion: 2.1 time: 0.175238 Jul 14 17:56:31.431213 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 239/549] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:31 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:56:32.193800 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-7a42c5dd-1369-412a-a7be-b5d069530d5d tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:32.194408 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-7a42c5dd-1369-412a-a7be-b5d069530d5d tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] [instance: 717f56d8-6ef5-45b6-8768-96c7a1efc733] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:32.213157 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7a42c5dd-1369-412a-a7be-b5d069530d5d tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:32.214447 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7a42c5dd-1369-412a-a7be-b5d069530d5d tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:32.215518 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7a42c5dd-1369-412a-a7be-b5d069530d5d tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:32.216300 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7a42c5dd-1369-412a-a7be-b5d069530d5d tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:32.284796 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-7a42c5dd-1369-412a-a7be-b5d069530d5d tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353609092f9b4a378478169ad8b90503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052d2b0826d04dd895c3621cf6d87e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:32.292875 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-7a42c5dd-1369-412a-a7be-b5d069530d5d tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] 10.222.0.64 "GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733" status: 200 len: 1219 microversion: 2.1 time: 0.103110 Jul 14 17:56:32.293463 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 240/550] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:32 2022] GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733 => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:56:32.449279 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-6a2eac83-5af9-4e3d-a629-203d69c65c41 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:32.449995 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-6a2eac83-5af9-4e3d-a629-203d69c65c41 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:32.456489 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6a2eac83-5af9-4e3d-a629-203d69c65c41 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:32.456944 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6a2eac83-5af9-4e3d-a629-203d69c65c41 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:32.457970 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6a2eac83-5af9-4e3d-a629-203d69c65c41 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:32.458419 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6a2eac83-5af9-4e3d-a629-203d69c65c41 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:32.619099 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-6a2eac83-5af9-4e3d-a629-203d69c65c41 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:32.628179 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-6a2eac83-5af9-4e3d-a629-203d69c65c41 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1358 microversion: 2.1 time: 0.183886 Jul 14 17:56:32.628782 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 241/551] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:32 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:56:33.311403 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-79b6cd6b-060d-48d2-9aa1-bd00596db36b tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:33.312122 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-79b6cd6b-060d-48d2-9aa1-bd00596db36b tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] [instance: 717f56d8-6ef5-45b6-8768-96c7a1efc733] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:33.318650 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-79b6cd6b-060d-48d2-9aa1-bd00596db36b tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:33.319104 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-79b6cd6b-060d-48d2-9aa1-bd00596db36b tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:33.319884 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-79b6cd6b-060d-48d2-9aa1-bd00596db36b tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:33.320386 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-79b6cd6b-060d-48d2-9aa1-bd00596db36b tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:33.390896 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-79b6cd6b-060d-48d2-9aa1-bd00596db36b tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353609092f9b4a378478169ad8b90503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052d2b0826d04dd895c3621cf6d87e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:33.400838 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-79b6cd6b-060d-48d2-9aa1-bd00596db36b tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] 10.222.0.64 "GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733" status: 200 len: 1219 microversion: 2.1 time: 0.093839 Jul 14 17:56:33.402349 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 242/552] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:33 2022] GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:56:33.501668 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-724fd91e-3f41-4c33-9cfa-4c94968a74e6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:56:33.502200 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-724fd91e-3f41-4c33-9cfa-4c94968a74e6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:33.508326 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-724fd91e-3f41-4c33-9cfa-4c94968a74e6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:33.508776 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-724fd91e-3f41-4c33-9cfa-4c94968a74e6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:33.509542 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-724fd91e-3f41-4c33-9cfa-4c94968a74e6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:33.509980 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-724fd91e-3f41-4c33-9cfa-4c94968a74e6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:33.534710 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.objects.instance [None req-724fd91e-3f41-4c33-9cfa-4c94968a74e6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lazy-loading 'flavor' on Instance uuid afa45fb8-7566-483d-95ce-8f0242138b17 {{(pid=129470) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 17:56:33.832273 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-724fd91e-3f41-4c33-9cfa-4c94968a74e6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "POST /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17/action" status: 202 len: 0 microversion: 2.20 time: 0.334296 Jul 14 17:56:33.833371 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 243/553] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Jul 14 17:56:33 2022] POST /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 14 17:56:33.838291 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-3c972b58-e6d7-464e-8240-562a8be5715f tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:33.839042 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-3c972b58-e6d7-464e-8240-562a8be5715f tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:33.846010 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3c972b58-e6d7-464e-8240-562a8be5715f tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:33.846688 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3c972b58-e6d7-464e-8240-562a8be5715f tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:33.847638 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3c972b58-e6d7-464e-8240-562a8be5715f tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:33.848300 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3c972b58-e6d7-464e-8240-562a8be5715f tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:34.023081 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-3c972b58-e6d7-464e-8240-562a8be5715f tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:34.037177 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-3c972b58-e6d7-464e-8240-562a8be5715f tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1358 microversion: 2.1 time: 0.202367 Jul 14 17:56:34.037891 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 244/554] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:33 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1358 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:34.047319 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-1855a73e-0c89-44be-b7c0-d9127da3cc62 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:34.048627 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-1855a73e-0c89-44be-b7c0-d9127da3cc62 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:34.062535 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1855a73e-0c89-44be-b7c0-d9127da3cc62 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:34.063369 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1855a73e-0c89-44be-b7c0-d9127da3cc62 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:34.064855 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1855a73e-0c89-44be-b7c0-d9127da3cc62 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:34.065681 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1855a73e-0c89-44be-b7c0-d9127da3cc62 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:34.252050 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-1855a73e-0c89-44be-b7c0-d9127da3cc62 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:34.267006 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-1855a73e-0c89-44be-b7c0-d9127da3cc62 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:34.269966 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-1855a73e-0c89-44be-b7c0-d9127da3cc62 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:34.272167 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-1855a73e-0c89-44be-b7c0-d9127da3cc62 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1725 microversion: 2.20 time: 0.232710 Jul 14 17:56:34.273233 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 245/555] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:56:34 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1725 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:56:34.423453 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-c35a3086-2ece-48db-aa78-3744025db1a9 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:34.424571 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-c35a3086-2ece-48db-aa78-3744025db1a9 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] [instance: 717f56d8-6ef5-45b6-8768-96c7a1efc733] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:34.433682 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c35a3086-2ece-48db-aa78-3744025db1a9 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:34.434276 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c35a3086-2ece-48db-aa78-3744025db1a9 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:34.435179 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c35a3086-2ece-48db-aa78-3744025db1a9 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:34.435716 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c35a3086-2ece-48db-aa78-3744025db1a9 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:34.532872 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-c35a3086-2ece-48db-aa78-3744025db1a9 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353609092f9b4a378478169ad8b90503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052d2b0826d04dd895c3621cf6d87e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:34.538833 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:34.550367 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-c35a3086-2ece-48db-aa78-3744025db1a9 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] 10.222.0.64 "GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733" status: 200 len: 1219 microversion: 2.1 time: 0.134127 Jul 14 17:56:34.551604 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 246/556] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:34 2022] GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733 => generated 1219 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:35.066584 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-bac6a482-74b2-46e2-9ac6-25ccbae26095 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:35.067655 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-bac6a482-74b2-46e2-9ac6-25ccbae26095 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:35.080515 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-bac6a482-74b2-46e2-9ac6-25ccbae26095 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:35.081332 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-bac6a482-74b2-46e2-9ac6-25ccbae26095 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:35.082687 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-bac6a482-74b2-46e2-9ac6-25ccbae26095 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:35.083680 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-bac6a482-74b2-46e2-9ac6-25ccbae26095 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:35.256533 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-bac6a482-74b2-46e2-9ac6-25ccbae26095 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:35.267312 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-bac6a482-74b2-46e2-9ac6-25ccbae26095 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1358 microversion: 2.1 time: 0.206284 Jul 14 17:56:35.267972 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 247/557] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:35 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:56:35.292274 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-0d273933-1f88-4f9e-8b4b-0ef083f34988 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:35.292896 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-0d273933-1f88-4f9e-8b4b-0ef083f34988 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:35.300148 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0d273933-1f88-4f9e-8b4b-0ef083f34988 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:35.300595 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0d273933-1f88-4f9e-8b4b-0ef083f34988 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:35.301388 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0d273933-1f88-4f9e-8b4b-0ef083f34988 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:35.301864 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0d273933-1f88-4f9e-8b4b-0ef083f34988 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:35.453102 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-0d273933-1f88-4f9e-8b4b-0ef083f34988 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:35.461655 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-0d273933-1f88-4f9e-8b4b-0ef083f34988 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:35.463180 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-0d273933-1f88-4f9e-8b4b-0ef083f34988 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:35.464922 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-0d273933-1f88-4f9e-8b4b-0ef083f34988 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1725 microversion: 2.20 time: 0.176838 Jul 14 17:56:35.465483 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 248/558] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:56:35 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:56:35.570753 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-798e453d-8f93-44a8-b226-cb120b67ba8a tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:35.571422 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-798e453d-8f93-44a8-b226-cb120b67ba8a tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] [instance: 717f56d8-6ef5-45b6-8768-96c7a1efc733] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:35.578433 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-798e453d-8f93-44a8-b226-cb120b67ba8a tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:35.578879 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-798e453d-8f93-44a8-b226-cb120b67ba8a tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:35.579656 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-798e453d-8f93-44a8-b226-cb120b67ba8a tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:35.580128 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-798e453d-8f93-44a8-b226-cb120b67ba8a tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:35.651165 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-798e453d-8f93-44a8-b226-cb120b67ba8a tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353609092f9b4a378478169ad8b90503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052d2b0826d04dd895c3621cf6d87e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:35.659884 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-798e453d-8f93-44a8-b226-cb120b67ba8a tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] 10.222.0.64 "GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733" status: 200 len: 1219 microversion: 2.1 time: 0.092877 Jul 14 17:56:35.660515 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 249/559] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:35 2022] GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:56:36.285323 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-2a1391ab-ae5b-489a-a2de-d53201479f00 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:36.285941 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-2a1391ab-ae5b-489a-a2de-d53201479f00 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:36.292909 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2a1391ab-ae5b-489a-a2de-d53201479f00 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:36.293367 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2a1391ab-ae5b-489a-a2de-d53201479f00 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:36.294169 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2a1391ab-ae5b-489a-a2de-d53201479f00 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:36.294643 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2a1391ab-ae5b-489a-a2de-d53201479f00 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:36.436692 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-2a1391ab-ae5b-489a-a2de-d53201479f00 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:36.444845 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-2a1391ab-ae5b-489a-a2de-d53201479f00 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1358 microversion: 2.1 time: 0.163344 Jul 14 17:56:36.445445 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 250/560] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:36 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:56:36.483737 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-a4c558b8-3a94-45ad-bb73-b65e399cfea4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:36.484576 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-a4c558b8-3a94-45ad-bb73-b65e399cfea4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:36.490712 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a4c558b8-3a94-45ad-bb73-b65e399cfea4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:36.491153 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a4c558b8-3a94-45ad-bb73-b65e399cfea4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:36.491997 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a4c558b8-3a94-45ad-bb73-b65e399cfea4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:36.492452 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a4c558b8-3a94-45ad-bb73-b65e399cfea4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:36.633547 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-a4c558b8-3a94-45ad-bb73-b65e399cfea4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:36.642629 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-a4c558b8-3a94-45ad-bb73-b65e399cfea4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:36.644219 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-a4c558b8-3a94-45ad-bb73-b65e399cfea4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:36.645410 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-a4c558b8-3a94-45ad-bb73-b65e399cfea4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1725 microversion: 2.20 time: 0.165732 Jul 14 17:56:36.645996 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 251/561] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:56:36 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:56:36.676663 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-3907faef-5d90-419f-b2a5-8e7749a02177 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:36.677277 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-3907faef-5d90-419f-b2a5-8e7749a02177 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] [instance: 717f56d8-6ef5-45b6-8768-96c7a1efc733] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:36.683983 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3907faef-5d90-419f-b2a5-8e7749a02177 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:36.684439 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3907faef-5d90-419f-b2a5-8e7749a02177 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:36.685510 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3907faef-5d90-419f-b2a5-8e7749a02177 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:36.685666 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3907faef-5d90-419f-b2a5-8e7749a02177 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:36.750394 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-3907faef-5d90-419f-b2a5-8e7749a02177 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353609092f9b4a378478169ad8b90503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052d2b0826d04dd895c3621cf6d87e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:36.757862 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-3907faef-5d90-419f-b2a5-8e7749a02177 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] 10.222.0.64 "GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733" status: 200 len: 1219 microversion: 2.1 time: 0.085038 Jul 14 17:56:36.758441 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 252/562] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:36 2022] GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:56:37.463236 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-44c81afe-31fa-4dfb-aa8d-a9f3d15f0dde tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:37.463848 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-44c81afe-31fa-4dfb-aa8d-a9f3d15f0dde tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:37.470895 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-44c81afe-31fa-4dfb-aa8d-a9f3d15f0dde tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:37.471474 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-44c81afe-31fa-4dfb-aa8d-a9f3d15f0dde tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:37.472356 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-44c81afe-31fa-4dfb-aa8d-a9f3d15f0dde tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:37.472779 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-44c81afe-31fa-4dfb-aa8d-a9f3d15f0dde tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:37.629061 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-44c81afe-31fa-4dfb-aa8d-a9f3d15f0dde tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:37.638160 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-44c81afe-31fa-4dfb-aa8d-a9f3d15f0dde tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1358 microversion: 2.1 time: 0.178923 Jul 14 17:56:37.638767 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 253/563] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:37 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:56:37.664887 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-9b534e31-dc6b-4d77-901d-c4f535bd03ac tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:37.665512 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-9b534e31-dc6b-4d77-901d-c4f535bd03ac tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:37.674183 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9b534e31-dc6b-4d77-901d-c4f535bd03ac tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:37.674983 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9b534e31-dc6b-4d77-901d-c4f535bd03ac tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:37.676488 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9b534e31-dc6b-4d77-901d-c4f535bd03ac tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:37.677269 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9b534e31-dc6b-4d77-901d-c4f535bd03ac tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:37.857934 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-9b534e31-dc6b-4d77-901d-c4f535bd03ac tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:37.867280 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-9b534e31-dc6b-4d77-901d-c4f535bd03ac tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:37.868997 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-9b534e31-dc6b-4d77-901d-c4f535bd03ac tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:37.870271 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-9b534e31-dc6b-4d77-901d-c4f535bd03ac tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1725 microversion: 2.20 time: 0.209491 Jul 14 17:56:37.871462 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 254/564] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:56:37 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1725 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:56:37.876492 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-b0913c53-4ddb-4379-8f9b-d1bbf1cfda33 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:37.877197 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-b0913c53-4ddb-4379-8f9b-d1bbf1cfda33 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] [instance: 717f56d8-6ef5-45b6-8768-96c7a1efc733] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:37.884965 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b0913c53-4ddb-4379-8f9b-d1bbf1cfda33 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:37.885426 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b0913c53-4ddb-4379-8f9b-d1bbf1cfda33 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:37.886891 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b0913c53-4ddb-4379-8f9b-d1bbf1cfda33 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:37.887343 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b0913c53-4ddb-4379-8f9b-d1bbf1cfda33 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:37.966572 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-b0913c53-4ddb-4379-8f9b-d1bbf1cfda33 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353609092f9b4a378478169ad8b90503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052d2b0826d04dd895c3621cf6d87e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:37.975212 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-b0913c53-4ddb-4379-8f9b-d1bbf1cfda33 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] 10.222.0.64 "GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733" status: 200 len: 1219 microversion: 2.1 time: 0.102434 Jul 14 17:56:37.975905 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 255/565] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:37 2022] GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733 => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:38.668966 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-23a6dad4-796b-4f20-8d03-8514c554b929 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:38.669752 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-23a6dad4-796b-4f20-8d03-8514c554b929 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:38.676580 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-23a6dad4-796b-4f20-8d03-8514c554b929 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:38.677038 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-23a6dad4-796b-4f20-8d03-8514c554b929 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:38.677824 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-23a6dad4-796b-4f20-8d03-8514c554b929 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:38.678290 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-23a6dad4-796b-4f20-8d03-8514c554b929 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:38.822212 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-23a6dad4-796b-4f20-8d03-8514c554b929 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:38.831901 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-23a6dad4-796b-4f20-8d03-8514c554b929 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1358 microversion: 2.1 time: 0.170503 Jul 14 17:56:38.832683 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 256/566] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:38 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:56:38.892454 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-f457f99c-4742-45b8-b4f3-5f249261e15a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:38.893069 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-f457f99c-4742-45b8-b4f3-5f249261e15a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:38.899413 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f457f99c-4742-45b8-b4f3-5f249261e15a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:38.899862 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f457f99c-4742-45b8-b4f3-5f249261e15a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:38.900682 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f457f99c-4742-45b8-b4f3-5f249261e15a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:38.901121 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f457f99c-4742-45b8-b4f3-5f249261e15a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:39.043838 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-f457f99c-4742-45b8-b4f3-5f249261e15a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:39.052457 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-f457f99c-4742-45b8-b4f3-5f249261e15a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:39.053971 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-f457f99c-4742-45b8-b4f3-5f249261e15a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:39.055196 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-f457f99c-4742-45b8-b4f3-5f249261e15a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1725 microversion: 2.20 time: 0.166896 Jul 14 17:56:39.055764 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 257/567] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:56:38 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:56:39.060887 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-16e47d93-9578-482a-89c2-91cfb586c159 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:39.061507 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-16e47d93-9578-482a-89c2-91cfb586c159 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] [instance: 717f56d8-6ef5-45b6-8768-96c7a1efc733] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:39.067963 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-16e47d93-9578-482a-89c2-91cfb586c159 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:39.068439 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-16e47d93-9578-482a-89c2-91cfb586c159 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:39.069222 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-16e47d93-9578-482a-89c2-91cfb586c159 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:39.069658 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-16e47d93-9578-482a-89c2-91cfb586c159 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:39.138131 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-16e47d93-9578-482a-89c2-91cfb586c159 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353609092f9b4a378478169ad8b90503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052d2b0826d04dd895c3621cf6d87e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:39.146114 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-16e47d93-9578-482a-89c2-91cfb586c159 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] 10.222.0.64 "GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733" status: 200 len: 1219 microversion: 2.1 time: 0.089255 Jul 14 17:56:39.146713 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 258/568] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:39 2022] GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:39.640624 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=88 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:39.860329 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-c0851c81-b0f2-434e-ae1d-f338ef67a07b tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:39.861991 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-c0851c81-b0f2-434e-ae1d-f338ef67a07b tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:39.864548 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell0:SELECT=2 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:39.866637 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell0:SELECT=12 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:39.878167 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c0851c81-b0f2-434e-ae1d-f338ef67a07b tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:39.879608 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c0851c81-b0f2-434e-ae1d-f338ef67a07b tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:39.883087 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c0851c81-b0f2-434e-ae1d-f338ef67a07b tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:39.883620 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-e9bfd6dd-84df-4c59-9c11-b3c1a8b6bee6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "POST /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.750466 Jul 14 17:56:39.883823 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c0851c81-b0f2-434e-ae1d-f338ef67a07b tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:39.885010 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 311/569] 10.222.0.64 () {60 vars in 1322 bytes} [Thu Jul 14 17:56:31 2022] POST /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba/os-volume_attachments => generated 194 bytes in 8753 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:56:40.062427 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-c0851c81-b0f2-434e-ae1d-f338ef67a07b tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:40.070952 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-c0851c81-b0f2-434e-ae1d-f338ef67a07b tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1358 microversion: 2.1 time: 0.221819 Jul 14 17:56:40.071199 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell0:SELECT=8 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:40.071985 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 259/570] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:39 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:40.077375 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-9a6898b1-d35e-4021-aa35-613253ff4eac tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:40.078314 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-9a6898b1-d35e-4021-aa35-613253ff4eac tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:40.082128 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:40.087847 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9a6898b1-d35e-4021-aa35-613253ff4eac tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:40.088366 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9a6898b1-d35e-4021-aa35-613253ff4eac tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:40.089167 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9a6898b1-d35e-4021-aa35-613253ff4eac tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:40.090124 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9a6898b1-d35e-4021-aa35-613253ff4eac tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:40.172664 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-48d04333-899e-4863-a99d-ecd07e24469e tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:40.173313 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-48d04333-899e-4863-a99d-ecd07e24469e tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] [instance: 717f56d8-6ef5-45b6-8768-96c7a1efc733] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:40.200793 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-48d04333-899e-4863-a99d-ecd07e24469e tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:40.201542 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-48d04333-899e-4863-a99d-ecd07e24469e tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:40.204078 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-48d04333-899e-4863-a99d-ecd07e24469e tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:40.204546 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-48d04333-899e-4863-a99d-ecd07e24469e tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:40.343750 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-48d04333-899e-4863-a99d-ecd07e24469e tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353609092f9b4a378478169ad8b90503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052d2b0826d04dd895c3621cf6d87e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:40.359504 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-48d04333-899e-4863-a99d-ecd07e24469e tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] 10.222.0.64 "GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733" status: 200 len: 1267 microversion: 2.1 time: 0.191555 Jul 14 17:56:40.363347 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 260/571] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:40 2022] GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733 => generated 1267 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:56:40.443064 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-9a6898b1-d35e-4021-aa35-613253ff4eac tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:40.456262 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-9a6898b1-d35e-4021-aa35-613253ff4eac tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:40.458823 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-9a6898b1-d35e-4021-aa35-613253ff4eac tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:40.461055 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-9a6898b1-d35e-4021-aa35-613253ff4eac tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1725 microversion: 2.20 time: 0.391216 Jul 14 17:56:40.473075 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 312/572] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:56:40 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1725 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:56:40.641448 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-d352999b-238d-45a6-98ee-969da4eb14a6 req-b9325452-ddd4-415f-ab19-29e2adc16437 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06993daa-d7b7-4496-b60f-71da361f1c19", "tag": "e4104856-b157-4b68-bc78-cbaf334757bd"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:56:40.658485 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-d352999b-238d-45a6-98ee-969da4eb14a6 req-b9325452-ddd4-415f-ab19-29e2adc16437 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:40.658936 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-d352999b-238d-45a6-98ee-969da4eb14a6 req-b9325452-ddd4-415f-ab19-29e2adc16437 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:40.687755 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-d352999b-238d-45a6-98ee-969da4eb14a6 req-b9325452-ddd4-415f-ab19-29e2adc16437 service nova] Creating event network-changed:e4104856-b157-4b68-bc78-cbaf334757bd for instance 06993daa-d7b7-4496-b60f-71da361f1c19 on hv-cinder-84989 Jul 14 17:56:40.699284 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-d352999b-238d-45a6-98ee-969da4eb14a6 req-b9325452-ddd4-415f-ab19-29e2adc16437 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062783 Jul 14 17:56:40.700746 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 261/573] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 17:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:56:41.089809 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-81874f29-ca25-41cb-b110-d3ac1efd70bd tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:41.090630 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-81874f29-ca25-41cb-b110-d3ac1efd70bd tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:41.100498 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-81874f29-ca25-41cb-b110-d3ac1efd70bd tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:41.101138 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-81874f29-ca25-41cb-b110-d3ac1efd70bd tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:41.102221 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-81874f29-ca25-41cb-b110-d3ac1efd70bd tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:41.103093 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-81874f29-ca25-41cb-b110-d3ac1efd70bd tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:41.285010 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-81874f29-ca25-41cb-b110-d3ac1efd70bd tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:41.299528 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-81874f29-ca25-41cb-b110-d3ac1efd70bd tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1358 microversion: 2.1 time: 0.213603 Jul 14 17:56:41.300640 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 313/574] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:41 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1358 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:41.392056 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-51ab4e25-7198-4f21-8a26-6f43e08d3b23 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:41.392777 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-51ab4e25-7198-4f21-8a26-6f43e08d3b23 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] [instance: 717f56d8-6ef5-45b6-8768-96c7a1efc733] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:41.399722 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-51ab4e25-7198-4f21-8a26-6f43e08d3b23 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:41.400271 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-51ab4e25-7198-4f21-8a26-6f43e08d3b23 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:41.401086 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-51ab4e25-7198-4f21-8a26-6f43e08d3b23 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:41.401536 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-51ab4e25-7198-4f21-8a26-6f43e08d3b23 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:41.468988 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-51ab4e25-7198-4f21-8a26-6f43e08d3b23 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353609092f9b4a378478169ad8b90503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052d2b0826d04dd895c3621cf6d87e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:41.478798 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-51ab4e25-7198-4f21-8a26-6f43e08d3b23 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] 10.222.0.64 "GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733" status: 200 len: 1273 microversion: 2.1 time: 0.092024 Jul 14 17:56:41.479565 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-9dd4fac1-c425-4963-9767-6f9afcbaafd0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:41.480247 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 262/575] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:41 2022] GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733 => generated 1273 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:41.489934 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-9dd4fac1-c425-4963-9767-6f9afcbaafd0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:41.496729 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9dd4fac1-c425-4963-9767-6f9afcbaafd0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:41.497179 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9dd4fac1-c425-4963-9767-6f9afcbaafd0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:41.497979 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9dd4fac1-c425-4963-9767-6f9afcbaafd0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:41.498744 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9dd4fac1-c425-4963-9767-6f9afcbaafd0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:41.713881 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-9dd4fac1-c425-4963-9767-6f9afcbaafd0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:41.726854 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-9dd4fac1-c425-4963-9767-6f9afcbaafd0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:41.729359 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-9dd4fac1-c425-4963-9767-6f9afcbaafd0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:41.731451 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-9dd4fac1-c425-4963-9767-6f9afcbaafd0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1725 microversion: 2.20 time: 0.256113 Jul 14 17:56:41.736012 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 314/576] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:56:41 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1725 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:56:42.319334 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-7ffe591c-4493-4873-aa18-b2ce3cc01464 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:42.319808 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-7ffe591c-4493-4873-aa18-b2ce3cc01464 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:42.327354 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7ffe591c-4493-4873-aa18-b2ce3cc01464 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:42.327802 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7ffe591c-4493-4873-aa18-b2ce3cc01464 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:42.328669 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7ffe591c-4493-4873-aa18-b2ce3cc01464 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:42.329196 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7ffe591c-4493-4873-aa18-b2ce3cc01464 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:42.490729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-7ffe591c-4493-4873-aa18-b2ce3cc01464 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:42.496665 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-afcf07d6-21d1-4e63-acb1-aaf00b5bbfe3 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:42.497892 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-afcf07d6-21d1-4e63-acb1-aaf00b5bbfe3 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] [instance: 717f56d8-6ef5-45b6-8768-96c7a1efc733] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:42.500687 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-7ffe591c-4493-4873-aa18-b2ce3cc01464 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1358 microversion: 2.1 time: 0.185714 Jul 14 17:56:42.501775 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 263/577] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:42 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:56:42.504940 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-afcf07d6-21d1-4e63-acb1-aaf00b5bbfe3 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:42.505391 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-afcf07d6-21d1-4e63-acb1-aaf00b5bbfe3 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:42.506165 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-afcf07d6-21d1-4e63-acb1-aaf00b5bbfe3 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:42.506601 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-afcf07d6-21d1-4e63-acb1-aaf00b5bbfe3 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:42.666026 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-afcf07d6-21d1-4e63-acb1-aaf00b5bbfe3 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353609092f9b4a378478169ad8b90503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052d2b0826d04dd895c3621cf6d87e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:42.675079 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-afcf07d6-21d1-4e63-acb1-aaf00b5bbfe3 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] 10.222.0.64 "GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733" status: 200 len: 1315 microversion: 2.1 time: 0.182752 Jul 14 17:56:42.675666 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 315/578] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:42 2022] GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:56:42.754630 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-c931c6f9-9652-4e0b-9b32-38f2ce9ae087 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:42.755309 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-c931c6f9-9652-4e0b-9b32-38f2ce9ae087 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:42.763555 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c931c6f9-9652-4e0b-9b32-38f2ce9ae087 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:42.764142 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c931c6f9-9652-4e0b-9b32-38f2ce9ae087 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:42.765253 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c931c6f9-9652-4e0b-9b32-38f2ce9ae087 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:42.765855 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c931c6f9-9652-4e0b-9b32-38f2ce9ae087 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:42.772554 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=100 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:42.930380 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-c931c6f9-9652-4e0b-9b32-38f2ce9ae087 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:42.945355 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-c931c6f9-9652-4e0b-9b32-38f2ce9ae087 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:42.948410 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-c931c6f9-9652-4e0b-9b32-38f2ce9ae087 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:42.950619 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-c931c6f9-9652-4e0b-9b32-38f2ce9ae087 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1725 microversion: 2.20 time: 0.201114 Jul 14 17:56:42.951653 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 264/579] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:56:42 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1725 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:56:43.521599 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-1d366806-ed7a-4698-9f32-517684b948d9 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:43.522216 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-1d366806-ed7a-4698-9f32-517684b948d9 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:43.529858 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1d366806-ed7a-4698-9f32-517684b948d9 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:43.530313 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1d366806-ed7a-4698-9f32-517684b948d9 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:43.531127 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1d366806-ed7a-4698-9f32-517684b948d9 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:43.531576 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1d366806-ed7a-4698-9f32-517684b948d9 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:43.671292 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-1d366806-ed7a-4698-9f32-517684b948d9 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:43.679149 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-1d366806-ed7a-4698-9f32-517684b948d9 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1358 microversion: 2.1 time: 0.161331 Jul 14 17:56:43.679736 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 316/580] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:43 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:56:43.698429 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-5fd7b5a3-6780-40c7-8222-ce3d8e10f13c tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:43.699568 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-5fd7b5a3-6780-40c7-8222-ce3d8e10f13c tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] [instance: 717f56d8-6ef5-45b6-8768-96c7a1efc733] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:43.711632 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5fd7b5a3-6780-40c7-8222-ce3d8e10f13c tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:43.712494 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5fd7b5a3-6780-40c7-8222-ce3d8e10f13c tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:43.713911 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5fd7b5a3-6780-40c7-8222-ce3d8e10f13c tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:43.714684 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5fd7b5a3-6780-40c7-8222-ce3d8e10f13c tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:43.882336 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-5fd7b5a3-6780-40c7-8222-ce3d8e10f13c tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353609092f9b4a378478169ad8b90503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052d2b0826d04dd895c3621cf6d87e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:43.890393 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-5fd7b5a3-6780-40c7-8222-ce3d8e10f13c tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] 10.222.0.64 "GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733" status: 200 len: 1315 microversion: 2.1 time: 0.199198 Jul 14 17:56:43.891013 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 265/581] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:43 2022] GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:56:43.970716 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-d22ba286-a7ea-4c6e-b417-ddfdc06927e4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:43.971337 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-d22ba286-a7ea-4c6e-b417-ddfdc06927e4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:43.977713 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d22ba286-a7ea-4c6e-b417-ddfdc06927e4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:43.978164 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d22ba286-a7ea-4c6e-b417-ddfdc06927e4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:43.978946 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d22ba286-a7ea-4c6e-b417-ddfdc06927e4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:43.979381 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d22ba286-a7ea-4c6e-b417-ddfdc06927e4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:44.130779 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-d22ba286-a7ea-4c6e-b417-ddfdc06927e4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:44.139397 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-d22ba286-a7ea-4c6e-b417-ddfdc06927e4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:44.140963 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-d22ba286-a7ea-4c6e-b417-ddfdc06927e4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:44.142170 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-d22ba286-a7ea-4c6e-b417-ddfdc06927e4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1725 microversion: 2.20 time: 0.175447 Jul 14 17:56:44.142720 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 317/582] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:56:43 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:56:44.696919 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-7a739f03-1167-463e-b4f1-8fbc16b67b10 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:44.697542 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-7a739f03-1167-463e-b4f1-8fbc16b67b10 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:44.705075 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7a739f03-1167-463e-b4f1-8fbc16b67b10 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:44.705749 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7a739f03-1167-463e-b4f1-8fbc16b67b10 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:44.706308 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7a739f03-1167-463e-b4f1-8fbc16b67b10 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:44.706752 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7a739f03-1167-463e-b4f1-8fbc16b67b10 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:44.857765 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-7a739f03-1167-463e-b4f1-8fbc16b67b10 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:44.867480 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-7a739f03-1167-463e-b4f1-8fbc16b67b10 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1358 microversion: 2.1 time: 0.174486 Jul 14 17:56:44.868118 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 266/583] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:44 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:44.910430 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-c006a355-b5b9-480d-b43e-c3740d5bac11 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:44.911678 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-c006a355-b5b9-480d-b43e-c3740d5bac11 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] [instance: 717f56d8-6ef5-45b6-8768-96c7a1efc733] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:44.922802 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c006a355-b5b9-480d-b43e-c3740d5bac11 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:44.923590 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c006a355-b5b9-480d-b43e-c3740d5bac11 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:44.924899 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c006a355-b5b9-480d-b43e-c3740d5bac11 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:44.925616 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c006a355-b5b9-480d-b43e-c3740d5bac11 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:45.094027 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-c006a355-b5b9-480d-b43e-c3740d5bac11 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353609092f9b4a378478169ad8b90503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052d2b0826d04dd895c3621cf6d87e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:45.102371 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-c006a355-b5b9-480d-b43e-c3740d5bac11 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] 10.222.0.64 "GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733" status: 200 len: 1315 microversion: 2.1 time: 0.198281 Jul 14 17:56:45.102980 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 318/584] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:44 2022] GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:45.161964 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-10f9ad3a-426b-4004-9a34-43da82986d0e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:45.162569 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-10f9ad3a-426b-4004-9a34-43da82986d0e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:45.170433 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-10f9ad3a-426b-4004-9a34-43da82986d0e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:45.170880 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-10f9ad3a-426b-4004-9a34-43da82986d0e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:45.171668 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-10f9ad3a-426b-4004-9a34-43da82986d0e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:45.172151 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-10f9ad3a-426b-4004-9a34-43da82986d0e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:45.337888 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-10f9ad3a-426b-4004-9a34-43da82986d0e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:45.346667 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-10f9ad3a-426b-4004-9a34-43da82986d0e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:45.348302 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-10f9ad3a-426b-4004-9a34-43da82986d0e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:45.349571 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-10f9ad3a-426b-4004-9a34-43da82986d0e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1725 microversion: 2.20 time: 0.191818 Jul 14 17:56:45.350155 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 267/585] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:56:45 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1725 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:56:45.885673 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-bdc41945-0f8e-400a-80de-6e13e98ecd84 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:45.886320 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-bdc41945-0f8e-400a-80de-6e13e98ecd84 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:45.904186 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bdc41945-0f8e-400a-80de-6e13e98ecd84 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:45.904852 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bdc41945-0f8e-400a-80de-6e13e98ecd84 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:45.905706 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bdc41945-0f8e-400a-80de-6e13e98ecd84 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:45.906167 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bdc41945-0f8e-400a-80de-6e13e98ecd84 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:46.062898 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-bdc41945-0f8e-400a-80de-6e13e98ecd84 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:46.072320 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-bdc41945-0f8e-400a-80de-6e13e98ecd84 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1358 microversion: 2.1 time: 0.190363 Jul 14 17:56:46.072926 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 319/586] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:45 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:46.127187 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-ba106c61-934d-4c78-bb2c-b469420e5dbe tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:46.128381 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-ba106c61-934d-4c78-bb2c-b469420e5dbe tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] [instance: 717f56d8-6ef5-45b6-8768-96c7a1efc733] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:46.142155 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ba106c61-934d-4c78-bb2c-b469420e5dbe tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:46.143028 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ba106c61-934d-4c78-bb2c-b469420e5dbe tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:46.144869 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ba106c61-934d-4c78-bb2c-b469420e5dbe tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:46.145825 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ba106c61-934d-4c78-bb2c-b469420e5dbe tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:46.315613 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-ba106c61-934d-4c78-bb2c-b469420e5dbe tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353609092f9b4a378478169ad8b90503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052d2b0826d04dd895c3621cf6d87e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:46.328911 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-ba106c61-934d-4c78-bb2c-b469420e5dbe tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] 10.222.0.64 "GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733" status: 200 len: 1315 microversion: 2.1 time: 0.210335 Jul 14 17:56:46.339349 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 268/587] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:46 2022] GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:56:46.372269 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-5ddae7fc-2f4b-4b27-8131-f30ad7b21a88 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:46.373639 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-5ddae7fc-2f4b-4b27-8131-f30ad7b21a88 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:46.383625 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5ddae7fc-2f4b-4b27-8131-f30ad7b21a88 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:46.384405 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5ddae7fc-2f4b-4b27-8131-f30ad7b21a88 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:46.385736 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5ddae7fc-2f4b-4b27-8131-f30ad7b21a88 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:46.386586 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5ddae7fc-2f4b-4b27-8131-f30ad7b21a88 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:46.536972 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-5ddae7fc-2f4b-4b27-8131-f30ad7b21a88 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:46.546900 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-5ddae7fc-2f4b-4b27-8131-f30ad7b21a88 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:46.548713 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-5ddae7fc-2f4b-4b27-8131-f30ad7b21a88 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:46.549927 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-5ddae7fc-2f4b-4b27-8131-f30ad7b21a88 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1725 microversion: 2.20 time: 0.185417 Jul 14 17:56:46.550499 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 320/588] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:56:46 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:56:47.078460 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-1364e042-964f-4411-8671-d16ca02101b8 req-0550615f-36e5-4e49-95a9-80990280081a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "717f56d8-6ef5-45b6-8768-96c7a1efc733", "tag": "3cc4da97-4e97-4f2f-974c-a52a8a10526f"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:56:47.091417 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-37987562-27db-46f6-a570-64873cf939a7 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:47.092052 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-37987562-27db-46f6-a570-64873cf939a7 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:47.099431 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-1364e042-964f-4411-8671-d16ca02101b8 req-0550615f-36e5-4e49-95a9-80990280081a service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:47.101964 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-37987562-27db-46f6-a570-64873cf939a7 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:47.102418 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-37987562-27db-46f6-a570-64873cf939a7 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:47.103219 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-37987562-27db-46f6-a570-64873cf939a7 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:47.103659 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-37987562-27db-46f6-a570-64873cf939a7 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:47.108566 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-1364e042-964f-4411-8671-d16ca02101b8 req-0550615f-36e5-4e49-95a9-80990280081a service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:47.128786 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-1364e042-964f-4411-8671-d16ca02101b8 req-0550615f-36e5-4e49-95a9-80990280081a service nova] Creating event network-changed:3cc4da97-4e97-4f2f-974c-a52a8a10526f for instance 717f56d8-6ef5-45b6-8768-96c7a1efc733 on hv-cinder-84989 Jul 14 17:56:47.134735 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-1364e042-964f-4411-8671-d16ca02101b8 req-0550615f-36e5-4e49-95a9-80990280081a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061003 Jul 14 17:56:47.135948 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 269/589] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 17:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:56:47.278734 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-37987562-27db-46f6-a570-64873cf939a7 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:47.286571 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-37987562-27db-46f6-a570-64873cf939a7 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1358 microversion: 2.1 time: 0.198989 Jul 14 17:56:47.287156 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 321/590] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:47 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:47.348339 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-e9e14424-f974-4e0b-a3d6-00a4539b13b4 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:47.348999 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-e9e14424-f974-4e0b-a3d6-00a4539b13b4 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] [instance: 717f56d8-6ef5-45b6-8768-96c7a1efc733] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:47.358823 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e9e14424-f974-4e0b-a3d6-00a4539b13b4 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:47.359589 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e9e14424-f974-4e0b-a3d6-00a4539b13b4 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:47.360599 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e9e14424-f974-4e0b-a3d6-00a4539b13b4 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:47.361429 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e9e14424-f974-4e0b-a3d6-00a4539b13b4 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:47.548969 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-e9e14424-f974-4e0b-a3d6-00a4539b13b4 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353609092f9b4a378478169ad8b90503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052d2b0826d04dd895c3621cf6d87e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:47.556798 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-e9e14424-f974-4e0b-a3d6-00a4539b13b4 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] 10.222.0.64 "GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733" status: 200 len: 1315 microversion: 2.1 time: 0.212927 Jul 14 17:56:47.557390 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 270/591] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:47 2022] GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:47.569099 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-1a8e1937-2ad4-4d76-b07c-24ef22a500f1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:47.569738 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-1a8e1937-2ad4-4d76-b07c-24ef22a500f1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:47.576166 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1a8e1937-2ad4-4d76-b07c-24ef22a500f1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:47.576613 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1a8e1937-2ad4-4d76-b07c-24ef22a500f1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:47.577399 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1a8e1937-2ad4-4d76-b07c-24ef22a500f1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:47.577830 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1a8e1937-2ad4-4d76-b07c-24ef22a500f1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:47.718401 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-1a8e1937-2ad4-4d76-b07c-24ef22a500f1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:47.727343 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-1a8e1937-2ad4-4d76-b07c-24ef22a500f1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:47.728898 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-1a8e1937-2ad4-4d76-b07c-24ef22a500f1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:47.730069 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-1a8e1937-2ad4-4d76-b07c-24ef22a500f1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1725 microversion: 2.20 time: 0.164939 Jul 14 17:56:47.731173 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 322/592] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:56:47 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:56:48.303734 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-214f158d-772f-4c30-b085-14d8607acbf4 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:48.304519 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-214f158d-772f-4c30-b085-14d8607acbf4 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:48.311663 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-214f158d-772f-4c30-b085-14d8607acbf4 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:48.312149 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-214f158d-772f-4c30-b085-14d8607acbf4 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:48.312930 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-214f158d-772f-4c30-b085-14d8607acbf4 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:48.313650 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-214f158d-772f-4c30-b085-14d8607acbf4 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:48.452673 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-214f158d-772f-4c30-b085-14d8607acbf4 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:48.461259 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-214f158d-772f-4c30-b085-14d8607acbf4 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1358 microversion: 2.1 time: 0.161787 Jul 14 17:56:48.461856 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 271/593] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:48 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:48.575717 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-11c1e1a9-2b0a-48e7-a719-880b9c12fa2c tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:48.576403 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-11c1e1a9-2b0a-48e7-a719-880b9c12fa2c tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] [instance: 717f56d8-6ef5-45b6-8768-96c7a1efc733] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:48.584362 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-11c1e1a9-2b0a-48e7-a719-880b9c12fa2c tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:48.585133 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-11c1e1a9-2b0a-48e7-a719-880b9c12fa2c tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:48.586393 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-11c1e1a9-2b0a-48e7-a719-880b9c12fa2c tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:48.586979 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-11c1e1a9-2b0a-48e7-a719-880b9c12fa2c tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:48.749123 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-98a80c8d-1c06-4f37-b4eb-61b4b1636c61 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:48.749983 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-98a80c8d-1c06-4f37-b4eb-61b4b1636c61 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:48.756903 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-98a80c8d-1c06-4f37-b4eb-61b4b1636c61 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:48.757369 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-98a80c8d-1c06-4f37-b4eb-61b4b1636c61 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:48.758416 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-98a80c8d-1c06-4f37-b4eb-61b4b1636c61 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:48.758865 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-98a80c8d-1c06-4f37-b4eb-61b4b1636c61 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:48.761380 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-11c1e1a9-2b0a-48e7-a719-880b9c12fa2c tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353609092f9b4a378478169ad8b90503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052d2b0826d04dd895c3621cf6d87e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:48.769688 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-11c1e1a9-2b0a-48e7-a719-880b9c12fa2c tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] 10.222.0.64 "GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733" status: 200 len: 1315 microversion: 2.1 time: 0.198636 Jul 14 17:56:48.770376 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 323/594] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:48 2022] GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:56:48.775547 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-63a25752-44fa-413d-87ff-c9ec16344f9a tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:56:48.782983 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-63a25752-44fa-413d-87ff-c9ec16344f9a tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:48.783440 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-63a25752-44fa-413d-87ff-c9ec16344f9a tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:48.848835 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-63a25752-44fa-413d-87ff-c9ec16344f9a tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Going to try to stop instance {{(pid=129471) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 17:56:48.902247 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-63a25752-44fa-413d-87ff-c9ec16344f9a tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "POST /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba/action" status: 202 len: 0 microversion: 2.1 time: 0.130626 Jul 14 17:56:48.903483 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 324/595] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Jul 14 17:56:48 2022] POST /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 17:56:48.912274 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-e4ab5a25-f1b7-44b4-be6b-eb403bf99b12 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:48.912969 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-e4ab5a25-f1b7-44b4-be6b-eb403bf99b12 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:48.920176 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e4ab5a25-f1b7-44b4-be6b-eb403bf99b12 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:48.920855 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e4ab5a25-f1b7-44b4-be6b-eb403bf99b12 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:48.921512 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e4ab5a25-f1b7-44b4-be6b-eb403bf99b12 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:48.921941 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e4ab5a25-f1b7-44b4-be6b-eb403bf99b12 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:49.140647 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-e4ab5a25-f1b7-44b4-be6b-eb403bf99b12 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:49.148814 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-e4ab5a25-f1b7-44b4-be6b-eb403bf99b12 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1722 microversion: 2.1 time: 0.240879 Jul 14 17:56:49.149393 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 325/596] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:48 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:56:49.154081 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-98a80c8d-1c06-4f37-b4eb-61b4b1636c61 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:49.162284 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-98a80c8d-1c06-4f37-b4eb-61b4b1636c61 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:49.163819 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-98a80c8d-1c06-4f37-b4eb-61b4b1636c61 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:49.165033 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-98a80c8d-1c06-4f37-b4eb-61b4b1636c61 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1725 microversion: 2.20 time: 0.419863 Jul 14 17:56:49.165587 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 272/597] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:56:48 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1725 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:56:49.478646 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-36e5b2bf-fe98-45c6-a310-e44cf31d47c5 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:49.479229 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-36e5b2bf-fe98-45c6-a310-e44cf31d47c5 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:49.486328 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-36e5b2bf-fe98-45c6-a310-e44cf31d47c5 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:49.486772 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-36e5b2bf-fe98-45c6-a310-e44cf31d47c5 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:49.487556 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-36e5b2bf-fe98-45c6-a310-e44cf31d47c5 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:49.488025 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-36e5b2bf-fe98-45c6-a310-e44cf31d47c5 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:49.505718 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:49.665411 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-36e5b2bf-fe98-45c6-a310-e44cf31d47c5 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:49.668979 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-71b92d49-8b09-4250-8119-fe1f95e3751f req-a5e7bf94-d8a8-4cbc-9b88-116bd5828c68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06993daa-d7b7-4496-b60f-71da361f1c19", "name": "network-vif-plugged", "status": "completed", "tag": "e4104856-b157-4b68-bc78-cbaf334757bd"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:56:49.685689 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-71b92d49-8b09-4250-8119-fe1f95e3751f req-a5e7bf94-d8a8-4cbc-9b88-116bd5828c68 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:49.686499 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-71b92d49-8b09-4250-8119-fe1f95e3751f req-a5e7bf94-d8a8-4cbc-9b88-116bd5828c68 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:49.687260 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-36e5b2bf-fe98-45c6-a310-e44cf31d47c5 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1358 microversion: 2.1 time: 0.211107 Jul 14 17:56:49.688860 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 326/598] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:49 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1358 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:56:49.700800 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-71b92d49-8b09-4250-8119-fe1f95e3751f req-a5e7bf94-d8a8-4cbc-9b88-116bd5828c68 service nova] Creating event network-vif-plugged:e4104856-b157-4b68-bc78-cbaf334757bd for instance 06993daa-d7b7-4496-b60f-71da361f1c19 on hv-cinder-84989 Jul 14 17:56:49.706006 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-71b92d49-8b09-4250-8119-fe1f95e3751f req-a5e7bf94-d8a8-4cbc-9b88-116bd5828c68 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045713 Jul 14 17:56:49.706763 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 273/599] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 17:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:56:49.786812 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-b5076629-1d4f-4b25-acf6-b8ab4f3b9589 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:49.787441 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-b5076629-1d4f-4b25-acf6-b8ab4f3b9589 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] [instance: 717f56d8-6ef5-45b6-8768-96c7a1efc733] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:49.795028 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b5076629-1d4f-4b25-acf6-b8ab4f3b9589 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:49.795495 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b5076629-1d4f-4b25-acf6-b8ab4f3b9589 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:49.796334 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b5076629-1d4f-4b25-acf6-b8ab4f3b9589 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:49.796775 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b5076629-1d4f-4b25-acf6-b8ab4f3b9589 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:49.933601 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-b5076629-1d4f-4b25-acf6-b8ab4f3b9589 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353609092f9b4a378478169ad8b90503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052d2b0826d04dd895c3621cf6d87e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:49.941318 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-b5076629-1d4f-4b25-acf6-b8ab4f3b9589 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] 10.222.0.64 "GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733" status: 200 len: 1315 microversion: 2.1 time: 0.158479 Jul 14 17:56:49.941895 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 327/600] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:49 2022] GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:50.169050 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-b14cd86b-192b-439a-b306-e895142843a9 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:50.169750 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-b14cd86b-192b-439a-b306-e895142843a9 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:50.177087 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b14cd86b-192b-439a-b306-e895142843a9 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:50.177502 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b14cd86b-192b-439a-b306-e895142843a9 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:50.178277 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b14cd86b-192b-439a-b306-e895142843a9 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:50.178704 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b14cd86b-192b-439a-b306-e895142843a9 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:50.182231 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-86ec1f35-839e-4fed-afc8-1f1d0fb0065c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:50.182850 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-86ec1f35-839e-4fed-afc8-1f1d0fb0065c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:50.189294 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-86ec1f35-839e-4fed-afc8-1f1d0fb0065c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:50.189744 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-86ec1f35-839e-4fed-afc8-1f1d0fb0065c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:50.190552 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-86ec1f35-839e-4fed-afc8-1f1d0fb0065c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:50.191000 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-86ec1f35-839e-4fed-afc8-1f1d0fb0065c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:50.387420 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-86ec1f35-839e-4fed-afc8-1f1d0fb0065c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:50.392061 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-b14cd86b-192b-439a-b306-e895142843a9 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:50.395717 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-86ec1f35-839e-4fed-afc8-1f1d0fb0065c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:50.397257 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-86ec1f35-839e-4fed-afc8-1f1d0fb0065c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:50.398446 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-86ec1f35-839e-4fed-afc8-1f1d0fb0065c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1725 microversion: 2.20 time: 0.220055 Jul 14 17:56:50.399032 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 328/601] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:56:50 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1725 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:56:50.400165 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-b14cd86b-192b-439a-b306-e895142843a9 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1722 microversion: 2.1 time: 0.235483 Jul 14 17:56:50.400737 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 274/602] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:50 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:56:50.706232 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-a123cfd0-ea6b-421d-87f3-c357ddb28b58 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:50.706861 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-a123cfd0-ea6b-421d-87f3-c357ddb28b58 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:50.713742 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a123cfd0-ea6b-421d-87f3-c357ddb28b58 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:50.714195 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a123cfd0-ea6b-421d-87f3-c357ddb28b58 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:50.715114 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a123cfd0-ea6b-421d-87f3-c357ddb28b58 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:50.715561 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a123cfd0-ea6b-421d-87f3-c357ddb28b58 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:50.910824 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-a123cfd0-ea6b-421d-87f3-c357ddb28b58 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:50.919285 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-a123cfd0-ea6b-421d-87f3-c357ddb28b58 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1358 microversion: 2.1 time: 0.216883 Jul 14 17:56:50.919873 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 329/603] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:50 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:50.962714 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-a89c8636-e1c5-4d02-933d-56552efef3e1 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:50.963807 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-a89c8636-e1c5-4d02-933d-56552efef3e1 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] [instance: 717f56d8-6ef5-45b6-8768-96c7a1efc733] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:50.976356 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a89c8636-e1c5-4d02-933d-56552efef3e1 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:50.977201 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a89c8636-e1c5-4d02-933d-56552efef3e1 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:50.978696 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a89c8636-e1c5-4d02-933d-56552efef3e1 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:50.979512 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a89c8636-e1c5-4d02-933d-56552efef3e1 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:51.116632 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-a89c8636-e1c5-4d02-933d-56552efef3e1 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353609092f9b4a378478169ad8b90503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052d2b0826d04dd895c3621cf6d87e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:51.125430 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-a89c8636-e1c5-4d02-933d-56552efef3e1 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] 10.222.0.64 "GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733" status: 200 len: 1315 microversion: 2.1 time: 0.170513 Jul 14 17:56:51.126021 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 275/604] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:50 2022] GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:51.417982 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-47929b34-80fc-4b6c-bc2c-7a5e69462c15 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:51.419485 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-47929b34-80fc-4b6c-bc2c-7a5e69462c15 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:51.425474 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-f9386cfa-6c7d-4c00-a1cc-900af679b505 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:51.426072 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-47929b34-80fc-4b6c-bc2c-7a5e69462c15 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:51.426195 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-f9386cfa-6c7d-4c00-a1cc-900af679b505 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:51.426529 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-47929b34-80fc-4b6c-bc2c-7a5e69462c15 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:51.427336 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-47929b34-80fc-4b6c-bc2c-7a5e69462c15 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:51.427784 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-47929b34-80fc-4b6c-bc2c-7a5e69462c15 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:51.432216 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f9386cfa-6c7d-4c00-a1cc-900af679b505 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:51.432668 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f9386cfa-6c7d-4c00-a1cc-900af679b505 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:51.433448 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f9386cfa-6c7d-4c00-a1cc-900af679b505 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:51.433942 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f9386cfa-6c7d-4c00-a1cc-900af679b505 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:51.639893 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-47929b34-80fc-4b6c-bc2c-7a5e69462c15 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:51.648515 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-f9386cfa-6c7d-4c00-a1cc-900af679b505 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:51.651119 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-47929b34-80fc-4b6c-bc2c-7a5e69462c15 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1722 microversion: 2.1 time: 0.237111 Jul 14 17:56:51.651882 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 330/605] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:51 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:51.664201 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-f9386cfa-6c7d-4c00-a1cc-900af679b505 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:51.667075 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-f9386cfa-6c7d-4c00-a1cc-900af679b505 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:51.670011 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-f9386cfa-6c7d-4c00-a1cc-900af679b505 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1725 microversion: 2.20 time: 0.248093 Jul 14 17:56:51.670992 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 276/606] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:56:51 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1725 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:56:51.937245 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-ce9397ce-be12-4836-9f26-47095ffb9760 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:51.937970 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-ce9397ce-be12-4836-9f26-47095ffb9760 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:51.944590 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ce9397ce-be12-4836-9f26-47095ffb9760 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:51.945041 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ce9397ce-be12-4836-9f26-47095ffb9760 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:51.945810 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ce9397ce-be12-4836-9f26-47095ffb9760 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:51.946245 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ce9397ce-be12-4836-9f26-47095ffb9760 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:52.081309 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-ce9397ce-be12-4836-9f26-47095ffb9760 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:52.089131 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-ce9397ce-be12-4836-9f26-47095ffb9760 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1358 microversion: 2.1 time: 0.156615 Jul 14 17:56:52.089691 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 331/607] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:51 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:52.142360 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-5ca4db9c-51e8-4318-80b9-cae8ef48a859 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:52.142974 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-5ca4db9c-51e8-4318-80b9-cae8ef48a859 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] [instance: 717f56d8-6ef5-45b6-8768-96c7a1efc733] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:52.149555 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5ca4db9c-51e8-4318-80b9-cae8ef48a859 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:52.150012 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5ca4db9c-51e8-4318-80b9-cae8ef48a859 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:52.150785 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5ca4db9c-51e8-4318-80b9-cae8ef48a859 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:52.151229 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5ca4db9c-51e8-4318-80b9-cae8ef48a859 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:52.284757 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-5ca4db9c-51e8-4318-80b9-cae8ef48a859 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353609092f9b4a378478169ad8b90503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052d2b0826d04dd895c3621cf6d87e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:52.292638 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-5ca4db9c-51e8-4318-80b9-cae8ef48a859 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] 10.222.0.64 "GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733" status: 200 len: 1315 microversion: 2.1 time: 0.154031 Jul 14 17:56:52.293261 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 277/608] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:52 2022] GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:52.669513 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-d88647f6-524d-4421-af3b-e86fb4439121 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:52.670036 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-d88647f6-524d-4421-af3b-e86fb4439121 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:52.676818 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d88647f6-524d-4421-af3b-e86fb4439121 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:52.677270 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d88647f6-524d-4421-af3b-e86fb4439121 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:52.678058 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d88647f6-524d-4421-af3b-e86fb4439121 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:52.678498 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d88647f6-524d-4421-af3b-e86fb4439121 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:52.688990 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-b2e47019-cfaf-4367-b678-e180342d52bc tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:52.689614 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-b2e47019-cfaf-4367-b678-e180342d52bc tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:52.696031 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b2e47019-cfaf-4367-b678-e180342d52bc tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:52.696488 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b2e47019-cfaf-4367-b678-e180342d52bc tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:52.697272 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b2e47019-cfaf-4367-b678-e180342d52bc tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:52.697718 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b2e47019-cfaf-4367-b678-e180342d52bc tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:52.892764 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-d88647f6-524d-4421-af3b-e86fb4439121 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:52.901273 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-d88647f6-524d-4421-af3b-e86fb4439121 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1722 microversion: 2.1 time: 0.235794 Jul 14 17:56:52.902107 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 332/609] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:52 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:52.902997 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-b2e47019-cfaf-4367-b678-e180342d52bc tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:52.911616 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-b2e47019-cfaf-4367-b678-e180342d52bc tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:52.913186 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-b2e47019-cfaf-4367-b678-e180342d52bc tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:52.914371 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-b2e47019-cfaf-4367-b678-e180342d52bc tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1725 microversion: 2.20 time: 0.229446 Jul 14 17:56:52.915081 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 278/610] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:56:52 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1725 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:56:53.106322 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-77c3f1aa-58fd-4044-a26c-76605cd77bdd tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:53.106980 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-77c3f1aa-58fd-4044-a26c-76605cd77bdd tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:53.113573 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-77c3f1aa-58fd-4044-a26c-76605cd77bdd tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:53.114028 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-77c3f1aa-58fd-4044-a26c-76605cd77bdd tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:53.114847 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-77c3f1aa-58fd-4044-a26c-76605cd77bdd tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:53.115510 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-77c3f1aa-58fd-4044-a26c-76605cd77bdd tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:53.251249 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-77c3f1aa-58fd-4044-a26c-76605cd77bdd tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:53.258741 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-77c3f1aa-58fd-4044-a26c-76605cd77bdd tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1358 microversion: 2.1 time: 0.156205 Jul 14 17:56:53.259308 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 333/611] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:53 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:53.309758 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-bd247432-8f82-4e21-8000-4dc58663441d tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:53.310387 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-bd247432-8f82-4e21-8000-4dc58663441d tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] [instance: 717f56d8-6ef5-45b6-8768-96c7a1efc733] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:53.319090 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-bd247432-8f82-4e21-8000-4dc58663441d tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:53.319539 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-bd247432-8f82-4e21-8000-4dc58663441d tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:53.320345 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-bd247432-8f82-4e21-8000-4dc58663441d tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:53.320775 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-bd247432-8f82-4e21-8000-4dc58663441d tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:53.490302 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-bd247432-8f82-4e21-8000-4dc58663441d tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353609092f9b4a378478169ad8b90503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052d2b0826d04dd895c3621cf6d87e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:53.498585 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-bd247432-8f82-4e21-8000-4dc58663441d tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] 10.222.0.64 "GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733" status: 200 len: 1315 microversion: 2.1 time: 0.193298 Jul 14 17:56:53.499179 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 279/612] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:53 2022] GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:53.923820 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-fb231118-912c-433c-a03d-0fe83798b14c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:53.924469 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-fb231118-912c-433c-a03d-0fe83798b14c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:53.931713 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fb231118-912c-433c-a03d-0fe83798b14c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:53.932213 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fb231118-912c-433c-a03d-0fe83798b14c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:53.932587 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-4a3a5580-c558-4b9d-8375-70714c26e6ad tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:53.932998 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fb231118-912c-433c-a03d-0fe83798b14c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:53.933181 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-4a3a5580-c558-4b9d-8375-70714c26e6ad tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:53.933441 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fb231118-912c-433c-a03d-0fe83798b14c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:53.939565 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4a3a5580-c558-4b9d-8375-70714c26e6ad tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:53.940055 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4a3a5580-c558-4b9d-8375-70714c26e6ad tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:53.940836 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4a3a5580-c558-4b9d-8375-70714c26e6ad tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:53.941291 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4a3a5580-c558-4b9d-8375-70714c26e6ad tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:54.132852 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-fb231118-912c-433c-a03d-0fe83798b14c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:54.142931 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-fb231118-912c-433c-a03d-0fe83798b14c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1722 microversion: 2.1 time: 0.222905 Jul 14 17:56:54.144084 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 334/613] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:53 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:54.147031 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-4a3a5580-c558-4b9d-8375-70714c26e6ad tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:54.159170 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-4a3a5580-c558-4b9d-8375-70714c26e6ad tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:54.160719 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-4a3a5580-c558-4b9d-8375-70714c26e6ad tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:54.162081 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-4a3a5580-c558-4b9d-8375-70714c26e6ad tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1725 microversion: 2.20 time: 0.233555 Jul 14 17:56:54.162647 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 280/614] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:56:53 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1725 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:56:54.169221 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [req-36ed459c-5420-4f42-8b79-2e3468f1f826 req-4a496e04-31a4-4cb4-a583-10164d09f489 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "717f56d8-6ef5-45b6-8768-96c7a1efc733", "name": "network-vif-plugged", "status": "completed", "tag": "3cc4da97-4e97-4f2f-974c-a52a8a10526f"}]} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:56:54.177869 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-36ed459c-5420-4f42-8b79-2e3468f1f826 req-4a496e04-31a4-4cb4-a583-10164d09f489 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:54.182780 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-36ed459c-5420-4f42-8b79-2e3468f1f826 req-4a496e04-31a4-4cb4-a583-10164d09f489 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:54.191915 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.compute.server_external_events [req-36ed459c-5420-4f42-8b79-2e3468f1f826 req-4a496e04-31a4-4cb4-a583-10164d09f489 service nova] Creating event network-vif-plugged:3cc4da97-4e97-4f2f-974c-a52a8a10526f for instance 717f56d8-6ef5-45b6-8768-96c7a1efc733 on hv-cinder-84989 Jul 14 17:56:54.201682 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [req-36ed459c-5420-4f42-8b79-2e3468f1f826 req-4a496e04-31a4-4cb4-a583-10164d09f489 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031926 Jul 14 17:56:54.201682 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 335/615] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 17:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 17:56:54.279329 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-73c750c3-f715-4aab-9f61-a2710288ceaf tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:54.280002 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-73c750c3-f715-4aab-9f61-a2710288ceaf tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:54.286964 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-73c750c3-f715-4aab-9f61-a2710288ceaf tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:54.287512 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-73c750c3-f715-4aab-9f61-a2710288ceaf tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:54.288400 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-73c750c3-f715-4aab-9f61-a2710288ceaf tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:54.288835 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-73c750c3-f715-4aab-9f61-a2710288ceaf tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:54.426758 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-73c750c3-f715-4aab-9f61-a2710288ceaf tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:54.434616 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-73c750c3-f715-4aab-9f61-a2710288ceaf tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1358 microversion: 2.1 time: 0.160285 Jul 14 17:56:54.435185 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 281/616] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:54 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:54.516734 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-c15145eb-02b5-4daa-9f46-26f05314f942 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:54.517436 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-c15145eb-02b5-4daa-9f46-26f05314f942 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] [instance: 717f56d8-6ef5-45b6-8768-96c7a1efc733] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:54.523740 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c15145eb-02b5-4daa-9f46-26f05314f942 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:54.524226 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c15145eb-02b5-4daa-9f46-26f05314f942 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:54.525006 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c15145eb-02b5-4daa-9f46-26f05314f942 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:54.525455 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c15145eb-02b5-4daa-9f46-26f05314f942 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:54.670080 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-c15145eb-02b5-4daa-9f46-26f05314f942 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353609092f9b4a378478169ad8b90503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052d2b0826d04dd895c3621cf6d87e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:54.677554 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-c15145eb-02b5-4daa-9f46-26f05314f942 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] 10.222.0.64 "GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733" status: 200 len: 1315 microversion: 2.1 time: 0.165776 Jul 14 17:56:54.678125 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 336/617] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:54 2022] GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:55.161287 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-8d957953-03bf-4cd0-b4c8-1c8f3e3c4ac8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:55.161832 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-8d957953-03bf-4cd0-b4c8-1c8f3e3c4ac8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:55.167883 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8d957953-03bf-4cd0-b4c8-1c8f3e3c4ac8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:55.168359 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8d957953-03bf-4cd0-b4c8-1c8f3e3c4ac8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:55.169758 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8d957953-03bf-4cd0-b4c8-1c8f3e3c4ac8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:55.170194 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8d957953-03bf-4cd0-b4c8-1c8f3e3c4ac8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:55.174182 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=100 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:55.180627 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-8e52f7b1-0e3e-4c4d-be73-bccfbb892963 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:55.181318 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-8e52f7b1-0e3e-4c4d-be73-bccfbb892963 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:55.188963 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8e52f7b1-0e3e-4c4d-be73-bccfbb892963 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:55.189434 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8e52f7b1-0e3e-4c4d-be73-bccfbb892963 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:55.190227 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8e52f7b1-0e3e-4c4d-be73-bccfbb892963 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:55.190670 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8e52f7b1-0e3e-4c4d-be73-bccfbb892963 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:55.397393 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-8d957953-03bf-4cd0-b4c8-1c8f3e3c4ac8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:55.401275 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-8e52f7b1-0e3e-4c4d-be73-bccfbb892963 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:55.413994 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-8d957953-03bf-4cd0-b4c8-1c8f3e3c4ac8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1722 microversion: 2.1 time: 0.256422 Jul 14 17:56:55.414936 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-8e52f7b1-0e3e-4c4d-be73-bccfbb892963 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:55.416786 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-8e52f7b1-0e3e-4c4d-be73-bccfbb892963 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:55.419267 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-8e52f7b1-0e3e-4c4d-be73-bccfbb892963 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1725 microversion: 2.20 time: 0.242101 Jul 14 17:56:55.425221 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 282/618] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:55 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1722 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:55.425744 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 337/619] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:56:55 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1725 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:56:55.451959 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-ef99944a-66f5-47bf-bead-19bf7bcc0e20 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:55.452574 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-ef99944a-66f5-47bf-bead-19bf7bcc0e20 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:55.458623 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ef99944a-66f5-47bf-bead-19bf7bcc0e20 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:55.459054 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ef99944a-66f5-47bf-bead-19bf7bcc0e20 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:55.460100 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ef99944a-66f5-47bf-bead-19bf7bcc0e20 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:55.460531 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ef99944a-66f5-47bf-bead-19bf7bcc0e20 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:55.597123 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-ef99944a-66f5-47bf-bead-19bf7bcc0e20 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:55.604670 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-ef99944a-66f5-47bf-bead-19bf7bcc0e20 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1358 microversion: 2.1 time: 0.157201 Jul 14 17:56:55.605243 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 283/620] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:55 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:55.694678 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-684df28b-81b1-4ecb-b7bd-1727875f1e2f tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:55.695283 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-684df28b-81b1-4ecb-b7bd-1727875f1e2f tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] [instance: 717f56d8-6ef5-45b6-8768-96c7a1efc733] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:55.701844 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-684df28b-81b1-4ecb-b7bd-1727875f1e2f tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:55.702288 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-684df28b-81b1-4ecb-b7bd-1727875f1e2f tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:55.703050 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-684df28b-81b1-4ecb-b7bd-1727875f1e2f tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:55.703486 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-684df28b-81b1-4ecb-b7bd-1727875f1e2f tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:55.837683 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-684df28b-81b1-4ecb-b7bd-1727875f1e2f tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353609092f9b4a378478169ad8b90503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052d2b0826d04dd895c3621cf6d87e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:55.846280 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-684df28b-81b1-4ecb-b7bd-1727875f1e2f tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] 10.222.0.64 "GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733" status: 200 len: 1315 microversion: 2.1 time: 0.155441 Jul 14 17:56:55.846958 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 338/621] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:55 2022] GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:56.432337 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-e75cbafa-8976-4bfb-afb2-443f594b81fb tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:56.432867 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-e75cbafa-8976-4bfb-afb2-443f594b81fb tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:56.437977 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-062d04f5-97e7-445d-b6dc-c596e331b30e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:56.438589 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-062d04f5-97e7-445d-b6dc-c596e331b30e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:56.440203 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e75cbafa-8976-4bfb-afb2-443f594b81fb tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:56.440661 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e75cbafa-8976-4bfb-afb2-443f594b81fb tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:56.441437 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e75cbafa-8976-4bfb-afb2-443f594b81fb tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:56.441879 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e75cbafa-8976-4bfb-afb2-443f594b81fb tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:56.444990 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-062d04f5-97e7-445d-b6dc-c596e331b30e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:56.445436 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-062d04f5-97e7-445d-b6dc-c596e331b30e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:56.446193 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-062d04f5-97e7-445d-b6dc-c596e331b30e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:56.446624 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-062d04f5-97e7-445d-b6dc-c596e331b30e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:56.648149 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-e75cbafa-8976-4bfb-afb2-443f594b81fb tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:56.655697 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-062d04f5-97e7-445d-b6dc-c596e331b30e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:56.657218 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-e75cbafa-8976-4bfb-afb2-443f594b81fb tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1722 microversion: 2.1 time: 0.228857 Jul 14 17:56:56.657815 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 284/622] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:56 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:56.662534 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-b363b0ba-6d73-46f1-9863-f1353b313cd5 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:56.663150 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-b363b0ba-6d73-46f1-9863-f1353b313cd5 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:56.664628 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-062d04f5-97e7-445d-b6dc-c596e331b30e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:56.666135 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-062d04f5-97e7-445d-b6dc-c596e331b30e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:56.667303 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-062d04f5-97e7-445d-b6dc-c596e331b30e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1725 microversion: 2.20 time: 0.233808 Jul 14 17:56:56.667854 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 339/623] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:56:56 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1725 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:56:56.671411 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b363b0ba-6d73-46f1-9863-f1353b313cd5 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:56.671863 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b363b0ba-6d73-46f1-9863-f1353b313cd5 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:56.672699 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b363b0ba-6d73-46f1-9863-f1353b313cd5 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:56.673136 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b363b0ba-6d73-46f1-9863-f1353b313cd5 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:56.804559 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-b363b0ba-6d73-46f1-9863-f1353b313cd5 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:56.813161 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-b363b0ba-6d73-46f1-9863-f1353b313cd5 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1548 microversion: 2.1 time: 0.154273 Jul 14 17:56:56.813766 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 285/624] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:56 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:56.832467 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-3686cd34-55fe-43cc-ba75-8106b7c451ef tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:56.833077 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-3686cd34-55fe-43cc-ba75-8106b7c451ef tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:56.839622 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3686cd34-55fe-43cc-ba75-8106b7c451ef tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:56.840113 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3686cd34-55fe-43cc-ba75-8106b7c451ef tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:56.841378 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3686cd34-55fe-43cc-ba75-8106b7c451ef tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:56.841815 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3686cd34-55fe-43cc-ba75-8106b7c451ef tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:56.863318 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-dbca530e-8a31-43c9-97aa-e4244ade0ec0 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:56.864008 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-dbca530e-8a31-43c9-97aa-e4244ade0ec0 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] [instance: 717f56d8-6ef5-45b6-8768-96c7a1efc733] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:56.870905 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-dbca530e-8a31-43c9-97aa-e4244ade0ec0 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:56.871361 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-dbca530e-8a31-43c9-97aa-e4244ade0ec0 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:56.872255 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-dbca530e-8a31-43c9-97aa-e4244ade0ec0 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:56.873127 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-dbca530e-8a31-43c9-97aa-e4244ade0ec0 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:57.055519 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-3686cd34-55fe-43cc-ba75-8106b7c451ef tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:57.060026 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-dbca530e-8a31-43c9-97aa-e4244ade0ec0 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353609092f9b4a378478169ad8b90503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052d2b0826d04dd895c3621cf6d87e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:57.063451 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-3686cd34-55fe-43cc-ba75-8106b7c451ef tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1548 microversion: 2.1 time: 0.234721 Jul 14 17:56:57.064065 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 340/625] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:56 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1548 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:57.070826 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-dbca530e-8a31-43c9-97aa-e4244ade0ec0 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] 10.222.0.64 "GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733" status: 200 len: 1315 microversion: 2.1 time: 0.211352 Jul 14 17:56:57.075726 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 286/626] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:56 2022] GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:56:57.092512 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-4e3aff19-ce05-49f2-85ef-db2dc83becd4 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:57.095253 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-4e3aff19-ce05-49f2-85ef-db2dc83becd4 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:57.096064 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-4e3aff19-ce05-49f2-85ef-db2dc83becd4 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Searching by: {'deleted': False, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d'} {{(pid=129471) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 17:56:57.103081 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4e3aff19-ce05-49f2-85ef-db2dc83becd4 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:57.103532 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4e3aff19-ce05-49f2-85ef-db2dc83becd4 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:57.104390 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4e3aff19-ce05-49f2-85ef-db2dc83becd4 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:57.104837 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4e3aff19-ce05-49f2-85ef-db2dc83becd4 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:57.195615 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.multi_cell_list [None req-4e3aff19-ce05-49f2-85ef-db2dc83becd4 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129471) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 17:56:57.304840 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-4e3aff19-ce05-49f2-85ef-db2dc83becd4 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.219023 Jul 14 17:56:57.305375 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 341/627] 10.222.0.64 () {58 vars in 1124 bytes} [Thu Jul 14 17:56:57 2022] GET /compute/v2.1/servers => generated 342 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:56:57.316546 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-16a65471-6420-45d3-8c02-c9836a615bf2 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:57.317254 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-16a65471-6420-45d3-8c02-c9836a615bf2 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:57.323515 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-16a65471-6420-45d3-8c02-c9836a615bf2 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:57.323966 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-16a65471-6420-45d3-8c02-c9836a615bf2 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:57.325337 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-16a65471-6420-45d3-8c02-c9836a615bf2 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:57.325783 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-16a65471-6420-45d3-8c02-c9836a615bf2 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:57.490282 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-16a65471-6420-45d3-8c02-c9836a615bf2 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:57.498944 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-16a65471-6420-45d3-8c02-c9836a615bf2 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1548 microversion: 2.1 time: 0.186309 Jul 14 17:56:57.499552 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 287/628] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:57 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1548 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:56:57.678846 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-822561ac-3780-4f37-8f78-c0583c1e0b9c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:57.682372 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-822561ac-3780-4f37-8f78-c0583c1e0b9c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:57.694415 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-822561ac-3780-4f37-8f78-c0583c1e0b9c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:57.694897 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-075edf1f-6482-48f8-a397-ad14682b4c16 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:57.695622 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-075edf1f-6482-48f8-a397-ad14682b4c16 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:57.696805 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-822561ac-3780-4f37-8f78-c0583c1e0b9c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:57.697943 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-822561ac-3780-4f37-8f78-c0583c1e0b9c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:57.699019 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-822561ac-3780-4f37-8f78-c0583c1e0b9c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:57.705685 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-075edf1f-6482-48f8-a397-ad14682b4c16 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:57.706514 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-075edf1f-6482-48f8-a397-ad14682b4c16 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:57.707985 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-075edf1f-6482-48f8-a397-ad14682b4c16 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:57.708881 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-075edf1f-6482-48f8-a397-ad14682b4c16 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:57.937766 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-075edf1f-6482-48f8-a397-ad14682b4c16 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:57.951640 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-075edf1f-6482-48f8-a397-ad14682b4c16 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:57.953575 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-075edf1f-6482-48f8-a397-ad14682b4c16 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:57.954933 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-075edf1f-6482-48f8-a397-ad14682b4c16 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1725 microversion: 2.20 time: 0.272090 Jul 14 17:56:57.955826 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 288/629] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:56:57 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1725 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:56:57.972287 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-822561ac-3780-4f37-8f78-c0583c1e0b9c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:57.982992 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-822561ac-3780-4f37-8f78-c0583c1e0b9c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1722 microversion: 2.1 time: 0.311596 Jul 14 17:56:57.993982 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 342/630] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:57 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1722 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:58.095921 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-078bc4a8-1806-4b1b-9cd9-cd4dec1895b1 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:58.096644 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-078bc4a8-1806-4b1b-9cd9-cd4dec1895b1 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] [instance: 717f56d8-6ef5-45b6-8768-96c7a1efc733] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:58.098656 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_api:SELECT=100 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:58.104049 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-078bc4a8-1806-4b1b-9cd9-cd4dec1895b1 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:58.104564 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-078bc4a8-1806-4b1b-9cd9-cd4dec1895b1 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:58.105348 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-078bc4a8-1806-4b1b-9cd9-cd4dec1895b1 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:58.105791 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-078bc4a8-1806-4b1b-9cd9-cd4dec1895b1 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:58.260266 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-078bc4a8-1806-4b1b-9cd9-cd4dec1895b1 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353609092f9b4a378478169ad8b90503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052d2b0826d04dd895c3621cf6d87e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:58.267870 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-078bc4a8-1806-4b1b-9cd9-cd4dec1895b1 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] 10.222.0.64 "GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733" status: 200 len: 1465 microversion: 2.1 time: 0.175982 Jul 14 17:56:58.268512 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 289/631] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:58 2022] GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733 => generated 1465 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:56:58.308646 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-13cca065-2e32-450f-a742-f107816471db tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:58.309182 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-13cca065-2e32-450f-a742-f107816471db tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] [instance: 717f56d8-6ef5-45b6-8768-96c7a1efc733] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:58.320247 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-13cca065-2e32-450f-a742-f107816471db tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:58.320705 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-13cca065-2e32-450f-a742-f107816471db tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:58.321500 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-13cca065-2e32-450f-a742-f107816471db tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:58.321946 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-13cca065-2e32-450f-a742-f107816471db tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:58.338046 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=100 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:58.349559 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-13cca065-2e32-450f-a742-f107816471db tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] [instance: 717f56d8-6ef5-45b6-8768-96c7a1efc733] Going to try to terminate instance {{(pid=129471) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 17:56:58.426182 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-13cca065-2e32-450f-a742-f107816471db tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] 10.222.0.64 "DELETE /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733" status: 204 len: 0 microversion: 2.1 time: 0.121131 Jul 14 17:56:58.426763 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 343/632] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Jul 14 17:56:58 2022] DELETE /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 17:56:58.434884 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-d27e8a98-de2e-4a93-8cc9-3b633d52ef7a tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:58.435495 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-d27e8a98-de2e-4a93-8cc9-3b633d52ef7a tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] [instance: 717f56d8-6ef5-45b6-8768-96c7a1efc733] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:58.442006 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d27e8a98-de2e-4a93-8cc9-3b633d52ef7a tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:58.442460 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d27e8a98-de2e-4a93-8cc9-3b633d52ef7a tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:58.443254 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d27e8a98-de2e-4a93-8cc9-3b633d52ef7a tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:58.443692 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d27e8a98-de2e-4a93-8cc9-3b633d52ef7a tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:58.579360 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-d27e8a98-de2e-4a93-8cc9-3b633d52ef7a tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353609092f9b4a378478169ad8b90503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052d2b0826d04dd895c3621cf6d87e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:58.587277 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-d27e8a98-de2e-4a93-8cc9-3b633d52ef7a tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] 10.222.0.64 "GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733" status: 200 len: 1471 microversion: 2.1 time: 0.156230 Jul 14 17:56:58.587857 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 290/633] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:58 2022] GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733 => generated 1471 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:58.973791 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-fd094036-648c-4c2a-90a2-5f6570aa53e1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:58.974607 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-fd094036-648c-4c2a-90a2-5f6570aa53e1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:58.982160 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fd094036-648c-4c2a-90a2-5f6570aa53e1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:58.982613 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fd094036-648c-4c2a-90a2-5f6570aa53e1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:58.983437 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fd094036-648c-4c2a-90a2-5f6570aa53e1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:58.984534 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fd094036-648c-4c2a-90a2-5f6570aa53e1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:59.003810 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-31ffe4ae-416d-4f1f-be21-3675fff31dfd tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:59.004566 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-31ffe4ae-416d-4f1f-be21-3675fff31dfd tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:59.011899 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-31ffe4ae-416d-4f1f-be21-3675fff31dfd tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:59.013272 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-31ffe4ae-416d-4f1f-be21-3675fff31dfd tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:59.014225 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-31ffe4ae-416d-4f1f-be21-3675fff31dfd tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:59.014719 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-31ffe4ae-416d-4f1f-be21-3675fff31dfd tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:59.216688 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-fd094036-648c-4c2a-90a2-5f6570aa53e1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:59.221451 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-31ffe4ae-416d-4f1f-be21-3675fff31dfd tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:59.230001 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-fd094036-648c-4c2a-90a2-5f6570aa53e1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:59.230371 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-31ffe4ae-416d-4f1f-be21-3675fff31dfd tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1722 microversion: 2.1 time: 0.231292 Jul 14 17:56:59.230893 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 291/634] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:58 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:56:59.233885 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-fd094036-648c-4c2a-90a2-5f6570aa53e1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:59.236235 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-fd094036-648c-4c2a-90a2-5f6570aa53e1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1725 microversion: 2.20 time: 0.266588 Jul 14 17:56:59.240400 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 344/635] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:56:58 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1725 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:56:59.607233 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-29f61a7a-7ec8-41d5-86e6-70208e8f9cf2 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:56:59.607859 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-29f61a7a-7ec8-41d5-86e6-70208e8f9cf2 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] [instance: 717f56d8-6ef5-45b6-8768-96c7a1efc733] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:56:59.614589 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-29f61a7a-7ec8-41d5-86e6-70208e8f9cf2 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:59.615065 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-29f61a7a-7ec8-41d5-86e6-70208e8f9cf2 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:59.615840 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-29f61a7a-7ec8-41d5-86e6-70208e8f9cf2 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:56:59.616331 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-29f61a7a-7ec8-41d5-86e6-70208e8f9cf2 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:56:59.754688 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-29f61a7a-7ec8-41d5-86e6-70208e8f9cf2 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353609092f9b4a378478169ad8b90503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052d2b0826d04dd895c3621cf6d87e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:56:59.763199 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-29f61a7a-7ec8-41d5-86e6-70208e8f9cf2 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] 10.222.0.64 "GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733" status: 200 len: 1471 microversion: 2.1 time: 0.161091 Jul 14 17:56:59.764111 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 292/636] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:56:59 2022] GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733 => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:57:00.249326 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-f24252a5-51bd-495c-8fb9-7f3a12732ad0 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:00.249990 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-f24252a5-51bd-495c-8fb9-7f3a12732ad0 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:00.257183 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f24252a5-51bd-495c-8fb9-7f3a12732ad0 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:00.257636 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f24252a5-51bd-495c-8fb9-7f3a12732ad0 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:00.258440 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f24252a5-51bd-495c-8fb9-7f3a12732ad0 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:00.258887 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f24252a5-51bd-495c-8fb9-7f3a12732ad0 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:00.268743 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-ba4a4002-6aa0-41d8-a0d6-1a2b53355a21 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:00.269559 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-ba4a4002-6aa0-41d8-a0d6-1a2b53355a21 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:00.276134 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ba4a4002-6aa0-41d8-a0d6-1a2b53355a21 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:00.276593 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ba4a4002-6aa0-41d8-a0d6-1a2b53355a21 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:00.277417 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ba4a4002-6aa0-41d8-a0d6-1a2b53355a21 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:00.277859 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ba4a4002-6aa0-41d8-a0d6-1a2b53355a21 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:00.466257 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-f24252a5-51bd-495c-8fb9-7f3a12732ad0 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:00.474625 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-f24252a5-51bd-495c-8fb9-7f3a12732ad0 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1722 microversion: 2.1 time: 0.230219 Jul 14 17:57:00.475221 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 345/637] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:57:00 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:57:00.479391 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-ba4a4002-6aa0-41d8-a0d6-1a2b53355a21 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:00.480030 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-08c10589-ac7e-4982-8719-f81fbbf8d34e tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dfe31ed8-944f-4c90-b6ce-3d14e5487d47"}} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:57:00.481127 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-08c10589-ac7e-4982-8719-f81fbbf8d34e tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:00.488023 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-08c10589-ac7e-4982-8719-f81fbbf8d34e tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:00.488472 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-08c10589-ac7e-4982-8719-f81fbbf8d34e tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:00.489265 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-08c10589-ac7e-4982-8719-f81fbbf8d34e tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:00.489699 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-08c10589-ac7e-4982-8719-f81fbbf8d34e tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:00.492167 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-ba4a4002-6aa0-41d8-a0d6-1a2b53355a21 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:00.495120 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-ba4a4002-6aa0-41d8-a0d6-1a2b53355a21 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:00.497646 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-ba4a4002-6aa0-41d8-a0d6-1a2b53355a21 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1725 microversion: 2.20 time: 0.242141 Jul 14 17:57:00.498388 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 293/638] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:00 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1725 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:57:00.780064 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-4f4b100f-55b6-4e6f-956d-70687affc560 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:00.780681 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-4f4b100f-55b6-4e6f-956d-70687affc560 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] [instance: 717f56d8-6ef5-45b6-8768-96c7a1efc733] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:00.787301 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4f4b100f-55b6-4e6f-956d-70687affc560 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:00.787748 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4f4b100f-55b6-4e6f-956d-70687affc560 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:00.788549 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4f4b100f-55b6-4e6f-956d-70687affc560 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:00.788989 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4f4b100f-55b6-4e6f-956d-70687affc560 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:00.949498 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-4f4b100f-55b6-4e6f-956d-70687affc560 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353609092f9b4a378478169ad8b90503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052d2b0826d04dd895c3621cf6d87e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:00.959341 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-4f4b100f-55b6-4e6f-956d-70687affc560 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] 10.222.0.64 "GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733" status: 200 len: 1471 microversion: 2.1 time: 0.183067 Jul 14 17:57:00.959949 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 294/639] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:57:00 2022] GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733 => generated 1471 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:57:01.502333 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-79460e22-d944-428d-b07f-52ba20877089 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:01.503032 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-79460e22-d944-428d-b07f-52ba20877089 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:01.509279 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-79460e22-d944-428d-b07f-52ba20877089 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:01.509723 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-79460e22-d944-428d-b07f-52ba20877089 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:01.510506 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-79460e22-d944-428d-b07f-52ba20877089 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:01.510944 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-79460e22-d944-428d-b07f-52ba20877089 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:01.661319 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-79460e22-d944-428d-b07f-52ba20877089 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:01.671139 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-79460e22-d944-428d-b07f-52ba20877089 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1722 microversion: 2.1 time: 0.172535 Jul 14 17:57:01.673752 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 295/640] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:57:01 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:57:01.676583 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-87364a98-1a3f-4776-b69e-547744895364 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:01.677152 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-87364a98-1a3f-4776-b69e-547744895364 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:01.683774 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-87364a98-1a3f-4776-b69e-547744895364 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:01.684419 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-87364a98-1a3f-4776-b69e-547744895364 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:01.685190 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-87364a98-1a3f-4776-b69e-547744895364 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:01.685626 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-87364a98-1a3f-4776-b69e-547744895364 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:01.803319 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-08c10589-ac7e-4982-8719-f81fbbf8d34e tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "POST /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.326817 Jul 14 17:57:01.804010 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 346/641] 10.222.0.64 () {60 vars in 1322 bytes} [Thu Jul 14 17:57:00 2022] POST /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19/os-volume_attachments => generated 194 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:57:01.844351 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-87364a98-1a3f-4776-b69e-547744895364 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:01.852506 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-87364a98-1a3f-4776-b69e-547744895364 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:01.854021 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-87364a98-1a3f-4776-b69e-547744895364 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:01.855195 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-87364a98-1a3f-4776-b69e-547744895364 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1746 microversion: 2.20 time: 0.182497 Jul 14 17:57:01.855750 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 296/642] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:01 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1746 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:57:01.979018 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-6855cbae-130c-4fd0-996a-84475320fae9 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:01.979769 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-6855cbae-130c-4fd0-996a-84475320fae9 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] [instance: 717f56d8-6ef5-45b6-8768-96c7a1efc733] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:01.986254 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6855cbae-130c-4fd0-996a-84475320fae9 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:01.986705 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6855cbae-130c-4fd0-996a-84475320fae9 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:01.987482 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6855cbae-130c-4fd0-996a-84475320fae9 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:01.987937 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6855cbae-130c-4fd0-996a-84475320fae9 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:02.170430 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-6855cbae-130c-4fd0-996a-84475320fae9 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353609092f9b4a378478169ad8b90503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052d2b0826d04dd895c3621cf6d87e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:02.179155 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-6855cbae-130c-4fd0-996a-84475320fae9 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] 10.222.0.64 "GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733" status: 200 len: 1471 microversion: 2.1 time: 0.204865 Jul 14 17:57:02.179738 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 347/643] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:57:01 2022] GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733 => generated 1471 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:57:02.486973 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-16b41ded-76f6-48d5-be55-7b5156373a18 req-62108b85-a9fd-4d9a-9136-73357b9d84b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "717f56d8-6ef5-45b6-8768-96c7a1efc733", "name": "network-vif-deleted", "tag": "3cc4da97-4e97-4f2f-974c-a52a8a10526f"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:57:02.498532 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-16b41ded-76f6-48d5-be55-7b5156373a18 req-62108b85-a9fd-4d9a-9136-73357b9d84b9 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:02.498991 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-16b41ded-76f6-48d5-be55-7b5156373a18 req-62108b85-a9fd-4d9a-9136-73357b9d84b9 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:02.513650 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-16b41ded-76f6-48d5-be55-7b5156373a18 req-62108b85-a9fd-4d9a-9136-73357b9d84b9 service nova] Creating event network-vif-deleted:3cc4da97-4e97-4f2f-974c-a52a8a10526f for instance 717f56d8-6ef5-45b6-8768-96c7a1efc733 on hv-cinder-84989 Jul 14 17:57:02.520369 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-16b41ded-76f6-48d5-be55-7b5156373a18 req-62108b85-a9fd-4d9a-9136-73357b9d84b9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039892 Jul 14 17:57:02.520980 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 297/644] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 17:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:57:02.688757 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-d9d2e845-e519-4740-93e9-ddc80299de78 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:02.689331 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-d9d2e845-e519-4740-93e9-ddc80299de78 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:02.696016 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d9d2e845-e519-4740-93e9-ddc80299de78 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:02.696475 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d9d2e845-e519-4740-93e9-ddc80299de78 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:02.697251 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d9d2e845-e519-4740-93e9-ddc80299de78 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:02.697689 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d9d2e845-e519-4740-93e9-ddc80299de78 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:02.846561 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-d9d2e845-e519-4740-93e9-ddc80299de78 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:02.854771 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-d9d2e845-e519-4740-93e9-ddc80299de78 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1722 microversion: 2.1 time: 0.169837 Jul 14 17:57:02.855281 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 348/645] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:57:02 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:57:02.876294 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-fd6c41a5-9cd4-410f-8166-daed6ab957d4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:02.877007 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-fd6c41a5-9cd4-410f-8166-daed6ab957d4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:02.884467 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fd6c41a5-9cd4-410f-8166-daed6ab957d4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:02.885008 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fd6c41a5-9cd4-410f-8166-daed6ab957d4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:02.885939 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fd6c41a5-9cd4-410f-8166-daed6ab957d4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:02.886309 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fd6c41a5-9cd4-410f-8166-daed6ab957d4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:03.019829 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-fd6c41a5-9cd4-410f-8166-daed6ab957d4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:03.027722 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-fd6c41a5-9cd4-410f-8166-daed6ab957d4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:03.029891 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-fd6c41a5-9cd4-410f-8166-daed6ab957d4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:03.031049 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-fd6c41a5-9cd4-410f-8166-daed6ab957d4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1746 microversion: 2.20 time: 0.160083 Jul 14 17:57:03.031622 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 298/646] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:02 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:57:03.197553 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-6ea7e3a0-b366-4e10-9da0-28251b0a3580 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:03.198196 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-6ea7e3a0-b366-4e10-9da0-28251b0a3580 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] [instance: 717f56d8-6ef5-45b6-8768-96c7a1efc733] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:03.205645 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6ea7e3a0-b366-4e10-9da0-28251b0a3580 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:03.207767 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6ea7e3a0-b366-4e10-9da0-28251b0a3580 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:03.207767 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6ea7e3a0-b366-4e10-9da0-28251b0a3580 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:03.207767 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6ea7e3a0-b366-4e10-9da0-28251b0a3580 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:03.223445 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.wsgi [None req-6ea7e3a0-b366-4e10-9da0-28251b0a3580 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] HTTP exception thrown: Instance 717f56d8-6ef5-45b6-8768-96c7a1efc733 could not be found. Jul 14 17:57:03.225355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-6ea7e3a0-b366-4e10-9da0-28251b0a3580 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Request method failure captured: Jul 14 17:57:03.225355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: request: GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733 HTTP/1.1 Jul 14 17:57:03.225355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept: application/json Jul 14 17:57:03.225355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept-Encoding: identity Jul 14 17:57:03.225355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Connection: close Jul 14 17:57:03.225355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Length: 0 Jul 14 17:57:03.225355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Type: application/json Jul 14 17:57:03.225355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Host: 10.222.0.64 Jul 14 17:57:03.225355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Openstack-System-Scope: None Jul 14 17:57:03.225355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: User-Agent: python-urllib3/1.26.9 Jul 14 17:57:03.225355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Auth-Token: gAAAAABi0FjKhYQL65VbFfaA9vruROlOSMuUEmejd8tn7JXdeMlHEwCfhILyaT5GLEKliUb9iZ9JyfbIoZJi0bNs8mWtYb-KcixI9YvOw8nbPXt7Gt1dYR7r0ktLpRfHLXQhap6igtEQ-KdAzLOfv_Uo4Ku__hZkdHb-GYlp9ePAGxVGYbo7NGI Jul 14 17:57:03.225355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Id: None Jul 14 17:57:03.225355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Name: None Jul 14 17:57:03.225355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Identity-Status: Confirmed Jul 14 17:57:03.225355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Is-Admin-Project: True Jul 14 17:57:03.225355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Id: default Jul 14 17:57:03.225355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Name: Default Jul 14 17:57:03.225355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Id: 052d2b0826d04dd895c3621cf6d87e17 Jul 14 17:57:03.225355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Name: tempest-VolumesNegativeTest-1860130701 Jul 14 17:57:03.225355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Role: reader,member Jul 14 17:57:03.225355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Roles: reader,member Jul 14 17:57:03.227002 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/052d2b0826d04dd895c3621cf6d87e17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/052d2b0826d04dd895c3621cf6d87e17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/052d2b0826d04dd895c3621cf6d87e17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_052d2b0826d04dd895c3621cf6d87e17", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 17:57:03.227002 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant: tempest-VolumesNegativeTest-1860130701 Jul 14 17:57:03.227002 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Id: 052d2b0826d04dd895c3621cf6d87e17 Jul 14 17:57:03.227002 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Name: tempest-VolumesNegativeTest-1860130701 Jul 14 17:57:03.227002 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User: tempest-VolumesNegativeTest-1860130701-project Jul 14 17:57:03.227002 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Id: default Jul 14 17:57:03.227002 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Name: Default Jul 14 17:57:03.227002 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Id: 353609092f9b4a378478169ad8b90503 Jul 14 17:57:03.227002 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Name: tempest-VolumesNegativeTest-1860130701-project Jul 14 17:57:03.227002 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: method: > Jul 14 17:57:03.227002 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: exception: Instance 717f56d8-6ef5-45b6-8768-96c7a1efc733 could not be found. Jul 14 17:57:03.227002 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: action_args: {'id': '717f56d8-6ef5-45b6-8768-96c7a1efc733'} Jul 14 17:57:03.231525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 17:57:03.231525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:57:03.231525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 17:57:03.231525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 17:57:03.231525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 17:57:03.231525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 17:57:03.231525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 17:57:03.231525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 17:57:03.231525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 17:57:03.231525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 17:57:03.231525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 717f56d8-6ef5-45b6-8768-96c7a1efc733 could not be found. Jul 14 17:57:03.231525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:57:03.231525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:57:03.231525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:57:03.231525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:57:03.231525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:57:03.231525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:57:03.231525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 17:57:03.231525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 17:57:03.231525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 17:57:03.232978 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 17:57:03.232978 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 17:57:03.232978 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 17:57:03.232978 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 17:57:03.232978 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 17:57:03.232978 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 17:57:03.232978 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 17:57:03.232978 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 717f56d8-6ef5-45b6-8768-96c7a1efc733 could not be found. Jul 14 17:57:03.232978 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:57:03.232978 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:57:03.232978 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:57:03.232978 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:57:03.232978 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:57:03.232978 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:57:03.232978 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 17:57:03.232978 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 17:57:03.232978 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 717f56d8-6ef5-45b6-8768-96c7a1efc733 could not be found. Jul 14 17:57:03.232978 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:57:03.234795 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-6ea7e3a0-b366-4e10-9da0-28251b0a3580 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] Returning 404 to user: Instance 717f56d8-6ef5-45b6-8768-96c7a1efc733 could not be found. {{(pid=129471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 17:57:03.234795 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-6ea7e3a0-b366-4e10-9da0-28251b0a3580 tempest-VolumesNegativeTest-1860130701 tempest-VolumesNegativeTest-1860130701-project] 10.222.0.64 "GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733" status: 404 len: 111 microversion: 2.1 time: 0.033281 Jul 14 17:57:03.234795 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 349/647] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:57:03 2022] GET /compute/v2.1/servers/717f56d8-6ef5-45b6-8768-96c7a1efc733 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 17:57:03.874520 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-41ace75b-4a5d-4d63-a28e-4764603180f7 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:03.875120 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-41ace75b-4a5d-4d63-a28e-4764603180f7 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:03.882298 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-41ace75b-4a5d-4d63-a28e-4764603180f7 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:03.882755 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-41ace75b-4a5d-4d63-a28e-4764603180f7 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:03.883579 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-41ace75b-4a5d-4d63-a28e-4764603180f7 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:03.884048 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-41ace75b-4a5d-4d63-a28e-4764603180f7 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:03.903668 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=100 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:04.041577 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-41ace75b-4a5d-4d63-a28e-4764603180f7 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:04.053327 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-41ace75b-4a5d-4d63-a28e-4764603180f7 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1722 microversion: 2.1 time: 0.183821 Jul 14 17:57:04.054202 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-ce43da82-fe9b-484c-acb9-208fd3d26f54 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:04.056145 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-ce43da82-fe9b-484c-acb9-208fd3d26f54 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:04.060742 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 299/648] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:57:03 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:57:04.067421 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ce43da82-fe9b-484c-acb9-208fd3d26f54 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:04.068287 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ce43da82-fe9b-484c-acb9-208fd3d26f54 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:04.069617 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ce43da82-fe9b-484c-acb9-208fd3d26f54 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:04.070234 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ce43da82-fe9b-484c-acb9-208fd3d26f54 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:04.230849 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-ce43da82-fe9b-484c-acb9-208fd3d26f54 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:04.239866 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-ce43da82-fe9b-484c-acb9-208fd3d26f54 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:04.241418 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-ce43da82-fe9b-484c-acb9-208fd3d26f54 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:04.242613 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-ce43da82-fe9b-484c-acb9-208fd3d26f54 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1746 microversion: 2.20 time: 0.195086 Jul 14 17:57:04.243174 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 350/649] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:04 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1746 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:57:04.272617 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-5d406cb3-a28a-40dc-8d4e-e319903468f6 req-9532e018-3290-4963-9e66-cdc8895ec863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afa45fb8-7566-483d-95ce-8f0242138b17", "name": "network-vif-plugged", "status": "completed", "tag": "babcf3c4-dfb9-4f4a-a0d8-6a98c8a91d00"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:57:04.281903 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-5d406cb3-a28a-40dc-8d4e-e319903468f6 req-9532e018-3290-4963-9e66-cdc8895ec863 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:04.282459 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-5d406cb3-a28a-40dc-8d4e-e319903468f6 req-9532e018-3290-4963-9e66-cdc8895ec863 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:04.294536 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-5d406cb3-a28a-40dc-8d4e-e319903468f6 req-9532e018-3290-4963-9e66-cdc8895ec863 service nova] Creating event network-vif-plugged:babcf3c4-dfb9-4f4a-a0d8-6a98c8a91d00 for instance afa45fb8-7566-483d-95ce-8f0242138b17 on hv-cinder-84989 Jul 14 17:57:04.300127 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-5d406cb3-a28a-40dc-8d4e-e319903468f6 req-9532e018-3290-4963-9e66-cdc8895ec863 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031186 Jul 14 17:57:04.300877 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 300/650] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 17:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:57:05.074002 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-55b12d52-6ce7-41d6-ad81-36cf91ded4fd tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:05.075133 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-55b12d52-6ce7-41d6-ad81-36cf91ded4fd tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:05.086816 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-55b12d52-6ce7-41d6-ad81-36cf91ded4fd tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:05.087601 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-55b12d52-6ce7-41d6-ad81-36cf91ded4fd tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:05.089032 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-55b12d52-6ce7-41d6-ad81-36cf91ded4fd tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:05.089813 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-55b12d52-6ce7-41d6-ad81-36cf91ded4fd tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:05.263151 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-55b12d52-6ce7-41d6-ad81-36cf91ded4fd tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:05.268536 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-b125dc69-655b-4786-b9f4-8dad3e9365cf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:05.270768 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-b125dc69-655b-4786-b9f4-8dad3e9365cf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:05.273111 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-55b12d52-6ce7-41d6-ad81-36cf91ded4fd tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1722 microversion: 2.1 time: 0.205542 Jul 14 17:57:05.273874 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 351/651] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:57:05 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:57:05.284470 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b125dc69-655b-4786-b9f4-8dad3e9365cf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:05.285318 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b125dc69-655b-4786-b9f4-8dad3e9365cf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:05.286928 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b125dc69-655b-4786-b9f4-8dad3e9365cf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:05.287728 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b125dc69-655b-4786-b9f4-8dad3e9365cf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:05.704860 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-b125dc69-655b-4786-b9f4-8dad3e9365cf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:05.714460 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-b125dc69-655b-4786-b9f4-8dad3e9365cf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:05.716551 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-b125dc69-655b-4786-b9f4-8dad3e9365cf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:05.718244 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-b125dc69-655b-4786-b9f4-8dad3e9365cf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1746 microversion: 2.20 time: 0.459958 Jul 14 17:57:05.718813 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 301/652] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:05 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1746 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:57:05.915606 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 17:57:05.915802 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Thu Jul 14 17:57:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 17:57:06.294412 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-cb1c6678-28a2-4a24-a97c-c2961c1be280 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:06.295107 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-cb1c6678-28a2-4a24-a97c-c2961c1be280 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:06.302083 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-cb1c6678-28a2-4a24-a97c-c2961c1be280 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:06.302790 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-cb1c6678-28a2-4a24-a97c-c2961c1be280 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:06.303581 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-cb1c6678-28a2-4a24-a97c-c2961c1be280 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:06.304041 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-cb1c6678-28a2-4a24-a97c-c2961c1be280 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:06.446630 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-cb1c6678-28a2-4a24-a97c-c2961c1be280 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:06.455578 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-cb1c6678-28a2-4a24-a97c-c2961c1be280 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1722 microversion: 2.1 time: 0.167596 Jul 14 17:57:06.456188 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 352/653] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:57:06 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:57:06.852851 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-5a531ffc-cf76-4e20-a04c-6f7309bd1d3d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:06.853473 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-5a531ffc-cf76-4e20-a04c-6f7309bd1d3d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:06.860589 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5a531ffc-cf76-4e20-a04c-6f7309bd1d3d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:06.861041 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5a531ffc-cf76-4e20-a04c-6f7309bd1d3d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:06.861823 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5a531ffc-cf76-4e20-a04c-6f7309bd1d3d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:06.862256 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5a531ffc-cf76-4e20-a04c-6f7309bd1d3d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:07.021163 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-5a531ffc-cf76-4e20-a04c-6f7309bd1d3d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:07.029571 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-5a531ffc-cf76-4e20-a04c-6f7309bd1d3d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:07.031065 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-5a531ffc-cf76-4e20-a04c-6f7309bd1d3d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:07.032317 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-5a531ffc-cf76-4e20-a04c-6f7309bd1d3d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1746 microversion: 2.20 time: 0.298349 Jul 14 17:57:07.032827 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 302/654] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:06 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1746 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:57:07.475376 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-3eb342a6-f0df-455e-969b-1025acdfec8b tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:07.476791 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-3eb342a6-f0df-455e-969b-1025acdfec8b tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:07.479761 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell0:SELECT=2 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:07.486518 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3eb342a6-f0df-455e-969b-1025acdfec8b tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:07.486518 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3eb342a6-f0df-455e-969b-1025acdfec8b tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:07.486518 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3eb342a6-f0df-455e-969b-1025acdfec8b tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:07.486518 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3eb342a6-f0df-455e-969b-1025acdfec8b tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:07.640364 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-3eb342a6-f0df-455e-969b-1025acdfec8b tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:07.644792 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-3eb342a6-f0df-455e-969b-1025acdfec8b tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1722 microversion: 2.1 time: 0.174334 Jul 14 17:57:07.645377 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 353/655] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:57:07 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:57:08.050386 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-5d9f9759-c44e-494c-97e7-99af6e563d60 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:08.051012 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-5d9f9759-c44e-494c-97e7-99af6e563d60 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:08.058581 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5d9f9759-c44e-494c-97e7-99af6e563d60 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:08.059032 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5d9f9759-c44e-494c-97e7-99af6e563d60 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:08.059836 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5d9f9759-c44e-494c-97e7-99af6e563d60 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:08.060400 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5d9f9759-c44e-494c-97e7-99af6e563d60 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:08.216590 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-5d9f9759-c44e-494c-97e7-99af6e563d60 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:08.226849 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-5d9f9759-c44e-494c-97e7-99af6e563d60 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:08.228604 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-5d9f9759-c44e-494c-97e7-99af6e563d60 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:08.229903 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-5d9f9759-c44e-494c-97e7-99af6e563d60 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1746 microversion: 2.20 time: 0.183532 Jul 14 17:57:08.235979 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 303/656] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:08 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1746 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:57:08.951691 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-7e15af77-5da8-4fc8-a945-206da7683896 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:08.952363 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-7e15af77-5da8-4fc8-a945-206da7683896 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:08.958551 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7e15af77-5da8-4fc8-a945-206da7683896 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:08.958998 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7e15af77-5da8-4fc8-a945-206da7683896 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:08.959776 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7e15af77-5da8-4fc8-a945-206da7683896 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:08.960239 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7e15af77-5da8-4fc8-a945-206da7683896 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:09.097498 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-7e15af77-5da8-4fc8-a945-206da7683896 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:09.106529 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-7e15af77-5da8-4fc8-a945-206da7683896 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1699 microversion: 2.1 time: 0.445131 Jul 14 17:57:09.107140 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 354/657] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:57:08 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1699 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:57:09.125276 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-a30538ea-1553-41db-9970-106c443df16f tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:57:09.132075 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a30538ea-1553-41db-9970-106c443df16f tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:09.132529 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a30538ea-1553-41db-9970-106c443df16f tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:09.193786 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-a30538ea-1553-41db-9970-106c443df16f tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Going to try to start instance {{(pid=129470) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 14 17:57:09.238604 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-a30538ea-1553-41db-9970-106c443df16f tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "POST /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba/action" status: 202 len: 0 microversion: 2.1 time: 0.117118 Jul 14 17:57:09.239223 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 304/658] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Jul 14 17:57:09 2022] POST /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 17:57:09.248068 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-183bea4e-1904-4eb6-9c70-24359ca79795 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:09.248769 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-183bea4e-1904-4eb6-9c70-24359ca79795 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:09.249891 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-98025d20-700b-468e-974f-7dfd487675c6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:09.250607 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-98025d20-700b-468e-974f-7dfd487675c6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:09.255180 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-183bea4e-1904-4eb6-9c70-24359ca79795 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:09.255640 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-183bea4e-1904-4eb6-9c70-24359ca79795 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:09.257082 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-183bea4e-1904-4eb6-9c70-24359ca79795 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:09.257184 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-98025d20-700b-468e-974f-7dfd487675c6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:09.257299 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-183bea4e-1904-4eb6-9c70-24359ca79795 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:09.257482 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-98025d20-700b-468e-974f-7dfd487675c6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:09.258373 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-98025d20-700b-468e-974f-7dfd487675c6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:09.258959 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-98025d20-700b-468e-974f-7dfd487675c6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:09.459045 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-98025d20-700b-468e-974f-7dfd487675c6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:09.462934 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-183bea4e-1904-4eb6-9c70-24359ca79795 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:09.467423 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-98025d20-700b-468e-974f-7dfd487675c6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:09.468956 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-98025d20-700b-468e-974f-7dfd487675c6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:09.470102 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-98025d20-700b-468e-974f-7dfd487675c6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1746 microversion: 2.20 time: 0.224828 Jul 14 17:57:09.470655 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 305/659] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:09 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1746 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:57:09.470973 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-183bea4e-1904-4eb6-9c70-24359ca79795 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1708 microversion: 2.1 time: 0.227091 Jul 14 17:57:09.471669 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 355/660] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:57:09 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1708 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:57:10.488027 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-90cc4516-81b2-4dd5-bf0c-8f6c455a04b8 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:10.488427 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-f31ac018-90c5-414b-90c1-ffffee11a239 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:10.488818 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-90cc4516-81b2-4dd5-bf0c-8f6c455a04b8 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:10.488968 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-f31ac018-90c5-414b-90c1-ffffee11a239 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:10.492358 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:10.495713 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-90cc4516-81b2-4dd5-bf0c-8f6c455a04b8 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:10.496266 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-90cc4516-81b2-4dd5-bf0c-8f6c455a04b8 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:10.497042 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-90cc4516-81b2-4dd5-bf0c-8f6c455a04b8 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:10.497475 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-90cc4516-81b2-4dd5-bf0c-8f6c455a04b8 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:10.500710 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f31ac018-90c5-414b-90c1-ffffee11a239 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:10.501372 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f31ac018-90c5-414b-90c1-ffffee11a239 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:10.503234 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f31ac018-90c5-414b-90c1-ffffee11a239 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:10.503872 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f31ac018-90c5-414b-90c1-ffffee11a239 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:10.719586 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-90cc4516-81b2-4dd5-bf0c-8f6c455a04b8 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:10.723289 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-f31ac018-90c5-414b-90c1-ffffee11a239 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:10.731778 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-90cc4516-81b2-4dd5-bf0c-8f6c455a04b8 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:10.733835 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-90cc4516-81b2-4dd5-bf0c-8f6c455a04b8 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:10.734168 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-f31ac018-90c5-414b-90c1-ffffee11a239 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1708 microversion: 2.1 time: 0.249557 Jul 14 17:57:10.735016 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-90cc4516-81b2-4dd5-bf0c-8f6c455a04b8 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1746 microversion: 2.20 time: 0.250935 Jul 14 17:57:10.735220 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 356/661] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:57:10 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1708 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:57:10.744674 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 306/662] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:10 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1746 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:57:11.536148 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-890304d1-a6e4-44c8-aacd-1ab3624f323b tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:11.536772 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-890304d1-a6e4-44c8-aacd-1ab3624f323b tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:11.543348 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-890304d1-a6e4-44c8-aacd-1ab3624f323b tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:11.543811 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-890304d1-a6e4-44c8-aacd-1ab3624f323b tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:11.544701 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-890304d1-a6e4-44c8-aacd-1ab3624f323b tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:11.545137 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-890304d1-a6e4-44c8-aacd-1ab3624f323b tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:11.693959 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-890304d1-a6e4-44c8-aacd-1ab3624f323b tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:11.696255 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:11.704503 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-890304d1-a6e4-44c8-aacd-1ab3624f323b tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1594 microversion: 2.1 time: 0.172099 Jul 14 17:57:11.705816 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 357/663] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:57:11 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1594 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:57:11.752731 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-d27a1f6c-a000-4b81-ab6b-78392d987079 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:11.754267 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-d27a1f6c-a000-4b81-ab6b-78392d987079 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:11.756248 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-192f6780-b931-44ad-9bca-07c3a286aa23 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:11.756996 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-192f6780-b931-44ad-9bca-07c3a286aa23 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:11.761688 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d27a1f6c-a000-4b81-ab6b-78392d987079 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:11.762234 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d27a1f6c-a000-4b81-ab6b-78392d987079 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:11.763075 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d27a1f6c-a000-4b81-ab6b-78392d987079 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:11.763810 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d27a1f6c-a000-4b81-ab6b-78392d987079 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:11.766840 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-192f6780-b931-44ad-9bca-07c3a286aa23 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:11.767292 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-192f6780-b931-44ad-9bca-07c3a286aa23 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:11.768240 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-192f6780-b931-44ad-9bca-07c3a286aa23 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:11.768679 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-192f6780-b931-44ad-9bca-07c3a286aa23 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:11.999319 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-d27a1f6c-a000-4b81-ab6b-78392d987079 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:12.013642 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-192f6780-b931-44ad-9bca-07c3a286aa23 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:12.017397 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-d27a1f6c-a000-4b81-ab6b-78392d987079 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:12.021390 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-d27a1f6c-a000-4b81-ab6b-78392d987079 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:12.022577 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-d27a1f6c-a000-4b81-ab6b-78392d987079 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1746 microversion: 2.20 time: 0.273881 Jul 14 17:57:12.022702 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-192f6780-b931-44ad-9bca-07c3a286aa23 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1708 microversion: 2.1 time: 0.273675 Jul 14 17:57:12.023139 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 307/664] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:11 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1746 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:57:12.032640 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 358/665] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:57:11 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1708 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:57:13.050239 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-97bf2252-7e18-4000-b5f3-48a529c127cb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:13.052281 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-7d0f255b-2b53-4b1e-96d5-de513f8bfc48 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:13.053803 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-97bf2252-7e18-4000-b5f3-48a529c127cb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:13.055698 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-7d0f255b-2b53-4b1e-96d5-de513f8bfc48 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:13.067315 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-97bf2252-7e18-4000-b5f3-48a529c127cb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:13.069587 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7d0f255b-2b53-4b1e-96d5-de513f8bfc48 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:13.070321 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-97bf2252-7e18-4000-b5f3-48a529c127cb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:13.071165 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-97bf2252-7e18-4000-b5f3-48a529c127cb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:13.071606 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-97bf2252-7e18-4000-b5f3-48a529c127cb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:13.076517 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7d0f255b-2b53-4b1e-96d5-de513f8bfc48 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:13.080688 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7d0f255b-2b53-4b1e-96d5-de513f8bfc48 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:13.086480 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7d0f255b-2b53-4b1e-96d5-de513f8bfc48 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:13.291132 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-97bf2252-7e18-4000-b5f3-48a529c127cb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:13.302949 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-97bf2252-7e18-4000-b5f3-48a529c127cb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:13.305397 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-97bf2252-7e18-4000-b5f3-48a529c127cb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:13.306899 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-97bf2252-7e18-4000-b5f3-48a529c127cb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1741 microversion: 2.20 time: 0.269136 Jul 14 17:57:13.307747 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 359/666] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:13 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1741 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:57:13.322601 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-7d0f255b-2b53-4b1e-96d5-de513f8bfc48 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:13.333595 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-7d0f255b-2b53-4b1e-96d5-de513f8bfc48 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1712 microversion: 2.1 time: 0.292380 Jul 14 17:57:13.334407 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 308/667] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:57:13 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1712 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:57:13.993882 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [req-663ed876-6e70-4220-a65e-acea68a51c91 req-1b0711ef-57f5-4cc0-8214-18a1aa9cbf9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06993daa-d7b7-4496-b60f-71da361f1c19", "tag": "e4104856-b157-4b68-bc78-cbaf334757bd"}]} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:57:14.013442 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-663ed876-6e70-4220-a65e-acea68a51c91 req-1b0711ef-57f5-4cc0-8214-18a1aa9cbf9c service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:14.015199 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-663ed876-6e70-4220-a65e-acea68a51c91 req-1b0711ef-57f5-4cc0-8214-18a1aa9cbf9c service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:14.044430 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.compute.server_external_events [req-663ed876-6e70-4220-a65e-acea68a51c91 req-1b0711ef-57f5-4cc0-8214-18a1aa9cbf9c service nova] Creating event network-changed:e4104856-b157-4b68-bc78-cbaf334757bd for instance 06993daa-d7b7-4496-b60f-71da361f1c19 on hv-cinder-84989 Jul 14 17:57:14.053894 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [req-663ed876-6e70-4220-a65e-acea68a51c91 req-1b0711ef-57f5-4cc0-8214-18a1aa9cbf9c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068693 Jul 14 17:57:14.056319 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 360/668] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 17:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:57:14.326626 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-72e13dc4-e2c5-486d-9a86-02c7f0628566 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:14.328230 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-72e13dc4-e2c5-486d-9a86-02c7f0628566 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:14.342136 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-72e13dc4-e2c5-486d-9a86-02c7f0628566 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:14.343559 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-72e13dc4-e2c5-486d-9a86-02c7f0628566 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:14.344588 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-72e13dc4-e2c5-486d-9a86-02c7f0628566 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:14.349214 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-72e13dc4-e2c5-486d-9a86-02c7f0628566 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:14.625903 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-72e13dc4-e2c5-486d-9a86-02c7f0628566 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:14.635679 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-72e13dc4-e2c5-486d-9a86-02c7f0628566 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:14.637245 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-72e13dc4-e2c5-486d-9a86-02c7f0628566 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:14.647351 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-72e13dc4-e2c5-486d-9a86-02c7f0628566 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1741 microversion: 2.20 time: 0.324743 Jul 14 17:57:14.652112 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 309/669] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:14 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1741 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:57:15.645728 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-0c4c0fed-3050-40c8-9f89-790de9d038da tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1322227927"}} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:57:15.647029 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-0c4c0fed-3050-40c8-9f89-790de9d038da tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:15.655132 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0c4c0fed-3050-40c8-9f89-790de9d038da tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:15.656201 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0c4c0fed-3050-40c8-9f89-790de9d038da tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:15.657316 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0c4c0fed-3050-40c8-9f89-790de9d038da tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:15.657761 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0c4c0fed-3050-40c8-9f89-790de9d038da tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:15.674207 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-d4312ddd-69a3-4705-a6e3-95ddcd38f33f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:15.675472 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-d4312ddd-69a3-4705-a6e3-95ddcd38f33f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:15.690033 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d4312ddd-69a3-4705-a6e3-95ddcd38f33f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:15.690798 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d4312ddd-69a3-4705-a6e3-95ddcd38f33f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:15.691800 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d4312ddd-69a3-4705-a6e3-95ddcd38f33f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:15.692250 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d4312ddd-69a3-4705-a6e3-95ddcd38f33f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:15.859438 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.network.security_group_api [None req-0c4c0fed-3050-40c8-9f89-790de9d038da tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Adding security group 4b41a172-4b31-4318-9116-438a3ed33cf0 to port e4104856-b157-4b68-bc78-cbaf334757bd Jul 14 17:57:15.919021 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-d4312ddd-69a3-4705-a6e3-95ddcd38f33f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:15.928266 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-d4312ddd-69a3-4705-a6e3-95ddcd38f33f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:15.929764 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-d4312ddd-69a3-4705-a6e3-95ddcd38f33f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:15.930922 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-d4312ddd-69a3-4705-a6e3-95ddcd38f33f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1741 microversion: 2.20 time: 0.261454 Jul 14 17:57:15.931477 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 310/670] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:15 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1741 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:57:16.310972 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-0c4c0fed-3050-40c8-9f89-790de9d038da tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "POST /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19/action" status: 202 len: 0 microversion: 2.1 time: 0.670236 Jul 14 17:57:16.312266 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 361/671] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Jul 14 17:57:15 2022] POST /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19/action => generated 0 bytes in 673 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 17:57:16.327326 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-7bb14b26-7524-48e5-a1c0-8f6833b9d8e8 req-ff7b1154-4204-428e-8794-784bde837cdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06993daa-d7b7-4496-b60f-71da361f1c19", "tag": "e4104856-b157-4b68-bc78-cbaf334757bd"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:57:16.336120 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-a11824ec-5478-44b8-a0ae-cde3980f26a8 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:16.339916 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-a11824ec-5478-44b8-a0ae-cde3980f26a8 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:16.361403 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-7bb14b26-7524-48e5-a1c0-8f6833b9d8e8 req-ff7b1154-4204-428e-8794-784bde837cdd service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:16.361858 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-7bb14b26-7524-48e5-a1c0-8f6833b9d8e8 req-ff7b1154-4204-428e-8794-784bde837cdd service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:16.371868 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a11824ec-5478-44b8-a0ae-cde3980f26a8 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:16.372362 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a11824ec-5478-44b8-a0ae-cde3980f26a8 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:16.373238 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a11824ec-5478-44b8-a0ae-cde3980f26a8 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:16.373603 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a11824ec-5478-44b8-a0ae-cde3980f26a8 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:16.395967 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-7bb14b26-7524-48e5-a1c0-8f6833b9d8e8 req-ff7b1154-4204-428e-8794-784bde837cdd service nova] Creating event network-changed:e4104856-b157-4b68-bc78-cbaf334757bd for instance 06993daa-d7b7-4496-b60f-71da361f1c19 on hv-cinder-84989 Jul 14 17:57:16.410526 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-7bb14b26-7524-48e5-a1c0-8f6833b9d8e8 req-ff7b1154-4204-428e-8794-784bde837cdd service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095982 Jul 14 17:57:16.411156 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 311/672] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 17:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:57:16.672090 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-a11824ec-5478-44b8-a0ae-cde3980f26a8 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:16.688078 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-a11824ec-5478-44b8-a0ae-cde3980f26a8 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1760 microversion: 2.1 time: 0.365656 Jul 14 17:57:16.690968 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 362/673] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:57:16 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1760 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:57:16.956052 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-7c15dbb9-589c-412e-9fff-cdc671ce7147 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:16.956906 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-7c15dbb9-589c-412e-9fff-cdc671ce7147 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:16.965609 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7c15dbb9-589c-412e-9fff-cdc671ce7147 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:16.966466 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7c15dbb9-589c-412e-9fff-cdc671ce7147 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:16.967485 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7c15dbb9-589c-412e-9fff-cdc671ce7147 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:16.968698 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7c15dbb9-589c-412e-9fff-cdc671ce7147 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:17.206536 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-7c15dbb9-589c-412e-9fff-cdc671ce7147 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:17.227099 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-7c15dbb9-589c-412e-9fff-cdc671ce7147 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:17.230975 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-7c15dbb9-589c-412e-9fff-cdc671ce7147 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:17.234246 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-7c15dbb9-589c-412e-9fff-cdc671ce7147 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1741 microversion: 2.20 time: 0.283365 Jul 14 17:57:17.247803 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 312/674] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:16 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1741 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:57:18.253765 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-5a161be1-c851-44fb-af29-76e52702a930 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:18.254499 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-5a161be1-c851-44fb-af29-76e52702a930 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:18.261508 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5a161be1-c851-44fb-af29-76e52702a930 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:18.262207 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5a161be1-c851-44fb-af29-76e52702a930 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:18.263181 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5a161be1-c851-44fb-af29-76e52702a930 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:18.263824 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5a161be1-c851-44fb-af29-76e52702a930 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:18.435585 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-5a161be1-c851-44fb-af29-76e52702a930 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:18.445265 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-5a161be1-c851-44fb-af29-76e52702a930 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:18.446684 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-5a161be1-c851-44fb-af29-76e52702a930 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:18.447847 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-5a161be1-c851-44fb-af29-76e52702a930 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1741 microversion: 2.20 time: 0.198119 Jul 14 17:57:18.448434 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 363/675] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:18 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1741 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:57:19.466998 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-e96e7cd0-8800-40a3-b73d-5e51ed8a4b66 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:19.468687 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-e96e7cd0-8800-40a3-b73d-5e51ed8a4b66 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:19.475303 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e96e7cd0-8800-40a3-b73d-5e51ed8a4b66 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:19.475795 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e96e7cd0-8800-40a3-b73d-5e51ed8a4b66 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:19.476635 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e96e7cd0-8800-40a3-b73d-5e51ed8a4b66 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:19.477082 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e96e7cd0-8800-40a3-b73d-5e51ed8a4b66 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:19.629881 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-e96e7cd0-8800-40a3-b73d-5e51ed8a4b66 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:19.638230 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-e96e7cd0-8800-40a3-b73d-5e51ed8a4b66 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:19.639772 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-e96e7cd0-8800-40a3-b73d-5e51ed8a4b66 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:19.641583 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-e96e7cd0-8800-40a3-b73d-5e51ed8a4b66 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1741 microversion: 2.20 time: 0.178524 Jul 14 17:57:19.650933 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 313/676] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:19 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1741 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:57:20.659991 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-bae25b11-2d89-4a60-82e6-4ef59d348c0a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:20.660597 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-bae25b11-2d89-4a60-82e6-4ef59d348c0a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:20.667269 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bae25b11-2d89-4a60-82e6-4ef59d348c0a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:20.667806 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bae25b11-2d89-4a60-82e6-4ef59d348c0a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:20.668677 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bae25b11-2d89-4a60-82e6-4ef59d348c0a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:20.669440 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bae25b11-2d89-4a60-82e6-4ef59d348c0a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:20.817338 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-bae25b11-2d89-4a60-82e6-4ef59d348c0a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:20.830225 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-bae25b11-2d89-4a60-82e6-4ef59d348c0a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:20.831738 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-bae25b11-2d89-4a60-82e6-4ef59d348c0a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:20.832973 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-bae25b11-2d89-4a60-82e6-4ef59d348c0a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1741 microversion: 2.20 time: 0.176979 Jul 14 17:57:20.833727 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 364/677] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:20 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1741 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:57:21.853245 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-c21e668a-051b-4a3d-97df-2c7ed2c6a4f3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:21.853909 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-c21e668a-051b-4a3d-97df-2c7ed2c6a4f3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:21.862059 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c21e668a-051b-4a3d-97df-2c7ed2c6a4f3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:21.862548 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c21e668a-051b-4a3d-97df-2c7ed2c6a4f3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:21.863375 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c21e668a-051b-4a3d-97df-2c7ed2c6a4f3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:21.863825 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c21e668a-051b-4a3d-97df-2c7ed2c6a4f3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:22.005878 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-c21e668a-051b-4a3d-97df-2c7ed2c6a4f3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:22.017908 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-c21e668a-051b-4a3d-97df-2c7ed2c6a4f3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:22.020372 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-c21e668a-051b-4a3d-97df-2c7ed2c6a4f3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:22.021589 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-c21e668a-051b-4a3d-97df-2c7ed2c6a4f3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1741 microversion: 2.20 time: 0.173026 Jul 14 17:57:22.022201 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 314/678] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:21 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1741 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:57:23.041143 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-553b3244-15b6-4bb7-ac76-32b1c9f2f772 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:23.041790 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-553b3244-15b6-4bb7-ac76-32b1c9f2f772 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:23.049244 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-553b3244-15b6-4bb7-ac76-32b1c9f2f772 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:23.050359 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-553b3244-15b6-4bb7-ac76-32b1c9f2f772 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:23.050570 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-553b3244-15b6-4bb7-ac76-32b1c9f2f772 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:23.050904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-553b3244-15b6-4bb7-ac76-32b1c9f2f772 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:23.216289 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-553b3244-15b6-4bb7-ac76-32b1c9f2f772 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:23.225601 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-553b3244-15b6-4bb7-ac76-32b1c9f2f772 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:23.227537 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-553b3244-15b6-4bb7-ac76-32b1c9f2f772 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:23.228777 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-553b3244-15b6-4bb7-ac76-32b1c9f2f772 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1741 microversion: 2.20 time: 0.191725 Jul 14 17:57:23.229338 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 365/679] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:23 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1741 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:57:24.256167 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-86a93886-39ac-49fc-a274-0adabbaaf2c0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:24.258763 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-86a93886-39ac-49fc-a274-0adabbaaf2c0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:24.270313 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-86a93886-39ac-49fc-a274-0adabbaaf2c0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:24.271177 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-86a93886-39ac-49fc-a274-0adabbaaf2c0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:24.272978 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-86a93886-39ac-49fc-a274-0adabbaaf2c0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:24.274076 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-86a93886-39ac-49fc-a274-0adabbaaf2c0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:24.448350 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-86a93886-39ac-49fc-a274-0adabbaaf2c0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:24.457162 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-86a93886-39ac-49fc-a274-0adabbaaf2c0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:24.458831 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-86a93886-39ac-49fc-a274-0adabbaaf2c0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:24.460137 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-86a93886-39ac-49fc-a274-0adabbaaf2c0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1741 microversion: 2.20 time: 0.214130 Jul 14 17:57:24.464504 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 315/680] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:24 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1741 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:57:25.480033 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-2e219681-73f6-41f5-ae47-88ff7b87c3d1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:25.480033 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-2e219681-73f6-41f5-ae47-88ff7b87c3d1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:25.487794 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2e219681-73f6-41f5-ae47-88ff7b87c3d1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:25.488719 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2e219681-73f6-41f5-ae47-88ff7b87c3d1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:25.490046 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2e219681-73f6-41f5-ae47-88ff7b87c3d1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:25.490842 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2e219681-73f6-41f5-ae47-88ff7b87c3d1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:25.635665 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-2e219681-73f6-41f5-ae47-88ff7b87c3d1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:25.644585 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-2e219681-73f6-41f5-ae47-88ff7b87c3d1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:25.646096 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-2e219681-73f6-41f5-ae47-88ff7b87c3d1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:25.647258 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-2e219681-73f6-41f5-ae47-88ff7b87c3d1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1741 microversion: 2.20 time: 0.172091 Jul 14 17:57:25.649887 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 366/681] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:25 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1741 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:57:26.666751 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-80f9600b-b7a5-4681-a9a5-dbf88c268b6d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:26.667386 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-80f9600b-b7a5-4681-a9a5-dbf88c268b6d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:26.674027 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-80f9600b-b7a5-4681-a9a5-dbf88c268b6d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:26.674547 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-80f9600b-b7a5-4681-a9a5-dbf88c268b6d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:26.676819 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-80f9600b-b7a5-4681-a9a5-dbf88c268b6d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:26.677336 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-80f9600b-b7a5-4681-a9a5-dbf88c268b6d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:26.697436 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:26.837171 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-80f9600b-b7a5-4681-a9a5-dbf88c268b6d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:26.845858 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-80f9600b-b7a5-4681-a9a5-dbf88c268b6d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:26.847490 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-80f9600b-b7a5-4681-a9a5-dbf88c268b6d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:26.848683 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-80f9600b-b7a5-4681-a9a5-dbf88c268b6d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1741 microversion: 2.20 time: 0.185861 Jul 14 17:57:26.849236 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 316/682] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:26 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1741 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:57:27.866797 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-fda05991-6dc7-41b7-bb15-2fdd453de920 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:27.867552 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-fda05991-6dc7-41b7-bb15-2fdd453de920 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:27.874604 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fda05991-6dc7-41b7-bb15-2fdd453de920 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:27.875064 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fda05991-6dc7-41b7-bb15-2fdd453de920 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:27.875846 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fda05991-6dc7-41b7-bb15-2fdd453de920 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:27.876529 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fda05991-6dc7-41b7-bb15-2fdd453de920 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:28.005093 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-fda05991-6dc7-41b7-bb15-2fdd453de920 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:28.013190 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-fda05991-6dc7-41b7-bb15-2fdd453de920 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:28.014707 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-fda05991-6dc7-41b7-bb15-2fdd453de920 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:28.016394 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-fda05991-6dc7-41b7-bb15-2fdd453de920 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1741 microversion: 2.20 time: 0.153051 Jul 14 17:57:28.016966 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 367/683] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:27 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1741 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:57:29.034578 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-a76a69a0-4a63-47c1-8265-46264dedce6b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:29.035166 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-a76a69a0-4a63-47c1-8265-46264dedce6b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:29.037543 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_api:SELECT=56 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:29.043577 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a76a69a0-4a63-47c1-8265-46264dedce6b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:29.044070 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a76a69a0-4a63-47c1-8265-46264dedce6b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:29.044857 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a76a69a0-4a63-47c1-8265-46264dedce6b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:29.045300 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a76a69a0-4a63-47c1-8265-46264dedce6b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:29.186918 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-a76a69a0-4a63-47c1-8265-46264dedce6b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:29.195360 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-a76a69a0-4a63-47c1-8265-46264dedce6b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:29.196910 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-a76a69a0-4a63-47c1-8265-46264dedce6b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:29.198117 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-a76a69a0-4a63-47c1-8265-46264dedce6b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1723 microversion: 2.20 time: 0.168208 Jul 14 17:57:29.198678 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 317/684] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:29 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:57:30.217160 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-282b996e-e502-4838-b981-f69c4ad8e923 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:30.217760 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-282b996e-e502-4838-b981-f69c4ad8e923 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:30.224952 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-282b996e-e502-4838-b981-f69c4ad8e923 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:30.225394 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-282b996e-e502-4838-b981-f69c4ad8e923 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:30.226149 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-282b996e-e502-4838-b981-f69c4ad8e923 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:30.226581 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-282b996e-e502-4838-b981-f69c4ad8e923 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:30.357567 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-282b996e-e502-4838-b981-f69c4ad8e923 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:30.365821 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-282b996e-e502-4838-b981-f69c4ad8e923 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:30.367356 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-282b996e-e502-4838-b981-f69c4ad8e923 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:30.368574 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-282b996e-e502-4838-b981-f69c4ad8e923 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1723 microversion: 2.20 time: 0.155286 Jul 14 17:57:30.369154 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 368/685] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:30 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:57:31.387530 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-64b64ae5-df88-4850-bc2d-da978b87e968 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:31.388277 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-64b64ae5-df88-4850-bc2d-da978b87e968 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:31.395201 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-64b64ae5-df88-4850-bc2d-da978b87e968 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:31.395647 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-64b64ae5-df88-4850-bc2d-da978b87e968 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:31.396469 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-64b64ae5-df88-4850-bc2d-da978b87e968 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:31.397457 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-64b64ae5-df88-4850-bc2d-da978b87e968 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:31.557764 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-64b64ae5-df88-4850-bc2d-da978b87e968 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:31.568220 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-64b64ae5-df88-4850-bc2d-da978b87e968 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:31.570079 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-64b64ae5-df88-4850-bc2d-da978b87e968 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:31.571387 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-64b64ae5-df88-4850-bc2d-da978b87e968 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1723 microversion: 2.20 time: 0.187857 Jul 14 17:57:31.571976 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 318/686] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:31 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:57:32.271841 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [req-5e37dd4a-1fa8-491c-9af6-130f9822689d req-7839d0d3-6e8d-4a28-a017-5ea3ecd6682e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afa45fb8-7566-483d-95ce-8f0242138b17", "name": "network-vif-unplugged", "status": "completed", "tag": "babcf3c4-dfb9-4f4a-a0d8-6a98c8a91d00"}]} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:57:32.285423 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-5e37dd4a-1fa8-491c-9af6-130f9822689d req-7839d0d3-6e8d-4a28-a017-5ea3ecd6682e service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:32.285907 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-5e37dd4a-1fa8-491c-9af6-130f9822689d req-7839d0d3-6e8d-4a28-a017-5ea3ecd6682e service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:32.297066 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.compute.server_external_events [req-5e37dd4a-1fa8-491c-9af6-130f9822689d req-7839d0d3-6e8d-4a28-a017-5ea3ecd6682e service nova] Unable to find a host for instance afa45fb8-7566-483d-95ce-8f0242138b17. Dropping event network-vif-unplugged {{(pid=129471) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 14 17:57:32.297951 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [req-5e37dd4a-1fa8-491c-9af6-130f9822689d req-7839d0d3-6e8d-4a28-a017-5ea3ecd6682e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031133 Jul 14 17:57:32.298537 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 369/687] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 17:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 14 17:57:32.590692 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-6ec0885a-b44e-4c13-abec-f50a60c64c02 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:32.591314 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-6ec0885a-b44e-4c13-abec-f50a60c64c02 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:32.598699 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6ec0885a-b44e-4c13-abec-f50a60c64c02 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:32.599160 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6ec0885a-b44e-4c13-abec-f50a60c64c02 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:32.600072 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6ec0885a-b44e-4c13-abec-f50a60c64c02 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:32.600561 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6ec0885a-b44e-4c13-abec-f50a60c64c02 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:32.747574 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-6ec0885a-b44e-4c13-abec-f50a60c64c02 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:32.756599 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-6ec0885a-b44e-4c13-abec-f50a60c64c02 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:32.758124 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-6ec0885a-b44e-4c13-abec-f50a60c64c02 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:32.759297 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-6ec0885a-b44e-4c13-abec-f50a60c64c02 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1666 microversion: 2.20 time: 0.172920 Jul 14 17:57:32.759879 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 319/688] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:32 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1666 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:57:32.777581 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-63eb7f5a-c9ad-4c23-be3d-267b3f308e14 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b0f0508-904a-48ea-986c-c6a71fc6ebe7"}} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:57:32.778743 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-63eb7f5a-c9ad-4c23-be3d-267b3f308e14 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:32.785008 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-63eb7f5a-c9ad-4c23-be3d-267b3f308e14 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:32.785448 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-63eb7f5a-c9ad-4c23-be3d-267b3f308e14 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:32.786224 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-63eb7f5a-c9ad-4c23-be3d-267b3f308e14 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:32.786651 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-63eb7f5a-c9ad-4c23-be3d-267b3f308e14 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:33.094887 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-63eb7f5a-c9ad-4c23-be3d-267b3f308e14 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "POST /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.321142 Jul 14 17:57:33.100779 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 370/689] 10.222.0.64 () {62 vars in 1363 bytes} [Thu Jul 14 17:57:32 2022] POST /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17/os-volume_attachments => generated 188 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 17:57:33.218922 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-e9409f68-2a50-44c7-9c5e-d53e200fc08d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:57:33.219442 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-e9409f68-2a50-44c7-9c5e-d53e200fc08d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:33.226551 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e9409f68-2a50-44c7-9c5e-d53e200fc08d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:33.226551 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e9409f68-2a50-44c7-9c5e-d53e200fc08d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:33.227137 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e9409f68-2a50-44c7-9c5e-d53e200fc08d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:33.227673 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e9409f68-2a50-44c7-9c5e-d53e200fc08d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:33.374959 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-e9409f68-2a50-44c7-9c5e-d53e200fc08d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "POST /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17/action" status: 202 len: 0 microversion: 2.20 time: 0.160103 Jul 14 17:57:33.375818 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 320/690] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Jul 14 17:57:33 2022] POST /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 17:57:33.384769 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-33c0cb43-e1f7-4c41-b041-43a40da77da5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:33.385520 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-33c0cb43-e1f7-4c41-b041-43a40da77da5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:33.393096 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-33c0cb43-e1f7-4c41-b041-43a40da77da5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:33.393542 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-33c0cb43-e1f7-4c41-b041-43a40da77da5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:33.394358 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-33c0cb43-e1f7-4c41-b041-43a40da77da5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:33.394805 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-33c0cb43-e1f7-4c41-b041-43a40da77da5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:33.561270 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-33c0cb43-e1f7-4c41-b041-43a40da77da5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:33.570740 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-33c0cb43-e1f7-4c41-b041-43a40da77da5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:33.572452 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-33c0cb43-e1f7-4c41-b041-43a40da77da5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:33.573922 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-33c0cb43-e1f7-4c41-b041-43a40da77da5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1752 microversion: 2.20 time: 0.193381 Jul 14 17:57:33.574566 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 371/691] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:33 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1752 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:57:34.594106 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-6d06ff2e-415e-420e-b705-bb7847769d65 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:34.594720 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-6d06ff2e-415e-420e-b705-bb7847769d65 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:34.601481 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6d06ff2e-415e-420e-b705-bb7847769d65 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:34.601932 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6d06ff2e-415e-420e-b705-bb7847769d65 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:34.602705 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6d06ff2e-415e-420e-b705-bb7847769d65 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:34.603145 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6d06ff2e-415e-420e-b705-bb7847769d65 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:34.738843 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-6d06ff2e-415e-420e-b705-bb7847769d65 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:34.748024 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-6d06ff2e-415e-420e-b705-bb7847769d65 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:34.749705 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-6d06ff2e-415e-420e-b705-bb7847769d65 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:34.750883 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-6d06ff2e-415e-420e-b705-bb7847769d65 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1754 microversion: 2.20 time: 0.161297 Jul 14 17:57:34.751384 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 321/692] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:34 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:57:35.771139 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-88c953e8-882d-41fa-a17c-0978eaf8c90b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:35.771920 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-88c953e8-882d-41fa-a17c-0978eaf8c90b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:35.778860 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-88c953e8-882d-41fa-a17c-0978eaf8c90b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:35.779309 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-88c953e8-882d-41fa-a17c-0978eaf8c90b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:35.780128 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-88c953e8-882d-41fa-a17c-0978eaf8c90b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:35.780600 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-88c953e8-882d-41fa-a17c-0978eaf8c90b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:35.907613 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-88c953e8-882d-41fa-a17c-0978eaf8c90b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:35.916080 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-88c953e8-882d-41fa-a17c-0978eaf8c90b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:35.917584 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-88c953e8-882d-41fa-a17c-0978eaf8c90b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:35.918755 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-88c953e8-882d-41fa-a17c-0978eaf8c90b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1810 microversion: 2.20 time: 0.152149 Jul 14 17:57:35.919321 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 372/693] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:35 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:57:36.937354 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-e7486b2c-56d5-4516-b8aa-6d87ad2c850b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:36.938126 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-e7486b2c-56d5-4516-b8aa-6d87ad2c850b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:36.946131 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e7486b2c-56d5-4516-b8aa-6d87ad2c850b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:36.946724 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e7486b2c-56d5-4516-b8aa-6d87ad2c850b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:36.947507 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e7486b2c-56d5-4516-b8aa-6d87ad2c850b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:36.947985 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e7486b2c-56d5-4516-b8aa-6d87ad2c850b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:37.110267 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-e7486b2c-56d5-4516-b8aa-6d87ad2c850b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:37.134158 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-e7486b2c-56d5-4516-b8aa-6d87ad2c850b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:37.135820 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-e7486b2c-56d5-4516-b8aa-6d87ad2c850b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:37.137129 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-e7486b2c-56d5-4516-b8aa-6d87ad2c850b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1810 microversion: 2.20 time: 0.203962 Jul 14 17:57:37.137775 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 322/694] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:36 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1810 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:57:38.156539 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-deb25b69-bd90-43e6-b566-c1aa407ddd77 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:38.157205 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-deb25b69-bd90-43e6-b566-c1aa407ddd77 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:38.164997 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-deb25b69-bd90-43e6-b566-c1aa407ddd77 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:38.165441 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-deb25b69-bd90-43e6-b566-c1aa407ddd77 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:38.166477 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-deb25b69-bd90-43e6-b566-c1aa407ddd77 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:38.167141 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-deb25b69-bd90-43e6-b566-c1aa407ddd77 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:38.184258 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:38.320428 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-deb25b69-bd90-43e6-b566-c1aa407ddd77 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:38.329195 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-deb25b69-bd90-43e6-b566-c1aa407ddd77 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:38.330734 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-deb25b69-bd90-43e6-b566-c1aa407ddd77 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:38.332505 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-deb25b69-bd90-43e6-b566-c1aa407ddd77 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1810 microversion: 2.20 time: 0.179933 Jul 14 17:57:38.333064 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 373/695] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:38 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1810 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:57:39.352581 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-364b25c1-690c-424e-ba14-b25ccdfda911 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:39.353877 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-364b25c1-690c-424e-ba14-b25ccdfda911 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:39.360643 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-364b25c1-690c-424e-ba14-b25ccdfda911 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:39.361150 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-364b25c1-690c-424e-ba14-b25ccdfda911 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:39.363188 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-364b25c1-690c-424e-ba14-b25ccdfda911 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:39.363188 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-364b25c1-690c-424e-ba14-b25ccdfda911 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:39.499069 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-364b25c1-690c-424e-ba14-b25ccdfda911 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:39.508257 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-364b25c1-690c-424e-ba14-b25ccdfda911 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:39.509860 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-364b25c1-690c-424e-ba14-b25ccdfda911 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:39.510944 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-364b25c1-690c-424e-ba14-b25ccdfda911 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1810 microversion: 2.20 time: 0.162612 Jul 14 17:57:39.511501 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 323/696] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:39 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:57:40.528985 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-0f2e98fb-2c2f-46d8-88d1-b830a94b47bf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:40.529778 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-0f2e98fb-2c2f-46d8-88d1-b830a94b47bf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:40.538059 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0f2e98fb-2c2f-46d8-88d1-b830a94b47bf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:40.538626 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0f2e98fb-2c2f-46d8-88d1-b830a94b47bf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:40.539427 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0f2e98fb-2c2f-46d8-88d1-b830a94b47bf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:40.539872 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0f2e98fb-2c2f-46d8-88d1-b830a94b47bf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:40.706746 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-0f2e98fb-2c2f-46d8-88d1-b830a94b47bf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:40.718327 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-0f2e98fb-2c2f-46d8-88d1-b830a94b47bf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:40.720270 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-0f2e98fb-2c2f-46d8-88d1-b830a94b47bf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:40.721791 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-0f2e98fb-2c2f-46d8-88d1-b830a94b47bf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1810 microversion: 2.20 time: 0.196673 Jul 14 17:57:40.723713 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 374/697] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:40 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1810 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:57:41.742336 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-ed40873e-d8d4-43e6-b85f-cb5186b7e3cf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:41.742965 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-ed40873e-d8d4-43e6-b85f-cb5186b7e3cf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:41.750844 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ed40873e-d8d4-43e6-b85f-cb5186b7e3cf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:41.751243 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ed40873e-d8d4-43e6-b85f-cb5186b7e3cf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:41.752074 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ed40873e-d8d4-43e6-b85f-cb5186b7e3cf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:41.752525 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ed40873e-d8d4-43e6-b85f-cb5186b7e3cf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:41.912659 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-ed40873e-d8d4-43e6-b85f-cb5186b7e3cf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:41.922593 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-ed40873e-d8d4-43e6-b85f-cb5186b7e3cf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:41.923862 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-ed40873e-d8d4-43e6-b85f-cb5186b7e3cf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:41.925112 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-ed40873e-d8d4-43e6-b85f-cb5186b7e3cf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1810 microversion: 2.20 time: 0.187318 Jul 14 17:57:41.925726 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 324/698] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:41 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1810 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:57:42.944819 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-04d90920-d02b-4667-b765-607568a7b9b5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:42.945462 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-04d90920-d02b-4667-b765-607568a7b9b5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:42.948198 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_api:SELECT=38 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:42.954715 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-04d90920-d02b-4667-b765-607568a7b9b5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:42.955247 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-04d90920-d02b-4667-b765-607568a7b9b5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:42.956153 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-04d90920-d02b-4667-b765-607568a7b9b5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:42.956760 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-04d90920-d02b-4667-b765-607568a7b9b5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:43.104154 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-04d90920-d02b-4667-b765-607568a7b9b5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:43.113317 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-04d90920-d02b-4667-b765-607568a7b9b5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:43.114812 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-04d90920-d02b-4667-b765-607568a7b9b5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:43.116502 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-04d90920-d02b-4667-b765-607568a7b9b5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1810 microversion: 2.20 time: 0.176156 Jul 14 17:57:43.117055 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 375/699] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:42 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:57:44.135865 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-cd17bf91-ed18-4e89-b52f-82df2facbd3c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:44.137238 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-cd17bf91-ed18-4e89-b52f-82df2facbd3c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:44.145102 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-cd17bf91-ed18-4e89-b52f-82df2facbd3c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:44.145561 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-cd17bf91-ed18-4e89-b52f-82df2facbd3c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:44.146357 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-cd17bf91-ed18-4e89-b52f-82df2facbd3c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:44.146800 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-cd17bf91-ed18-4e89-b52f-82df2facbd3c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:44.278888 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-cd17bf91-ed18-4e89-b52f-82df2facbd3c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:44.287375 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-cd17bf91-ed18-4e89-b52f-82df2facbd3c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:44.288904 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-cd17bf91-ed18-4e89-b52f-82df2facbd3c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:44.290057 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-cd17bf91-ed18-4e89-b52f-82df2facbd3c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1810 microversion: 2.20 time: 0.158610 Jul 14 17:57:44.290621 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 325/700] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:44 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:57:45.308130 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-519ed96a-1437-48f0-8e1e-4539189b0c3a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:45.309789 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-519ed96a-1437-48f0-8e1e-4539189b0c3a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:45.316978 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-519ed96a-1437-48f0-8e1e-4539189b0c3a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:45.317901 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-519ed96a-1437-48f0-8e1e-4539189b0c3a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:45.318265 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-519ed96a-1437-48f0-8e1e-4539189b0c3a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:45.318709 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-519ed96a-1437-48f0-8e1e-4539189b0c3a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:45.476636 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-519ed96a-1437-48f0-8e1e-4539189b0c3a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:45.486398 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-519ed96a-1437-48f0-8e1e-4539189b0c3a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:45.487974 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-519ed96a-1437-48f0-8e1e-4539189b0c3a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:45.489835 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-519ed96a-1437-48f0-8e1e-4539189b0c3a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1810 microversion: 2.20 time: 0.185722 Jul 14 17:57:45.490684 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 376/701] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:45 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1810 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:57:46.512463 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-5342da7a-88b5-4a8e-a120-ae373a720ee6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:46.513499 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-5342da7a-88b5-4a8e-a120-ae373a720ee6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:46.523213 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5342da7a-88b5-4a8e-a120-ae373a720ee6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:46.523665 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5342da7a-88b5-4a8e-a120-ae373a720ee6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:46.524487 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5342da7a-88b5-4a8e-a120-ae373a720ee6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:46.524926 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5342da7a-88b5-4a8e-a120-ae373a720ee6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:46.697149 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-5342da7a-88b5-4a8e-a120-ae373a720ee6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:46.709752 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-5342da7a-88b5-4a8e-a120-ae373a720ee6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:46.711597 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-5342da7a-88b5-4a8e-a120-ae373a720ee6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:46.712922 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-5342da7a-88b5-4a8e-a120-ae373a720ee6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1810 microversion: 2.20 time: 0.206807 Jul 14 17:57:46.713504 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 326/702] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:46 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1810 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:57:47.732543 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-3b2176cb-ade9-4250-83c5-f44ab02cb2d5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:47.733233 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-3b2176cb-ade9-4250-83c5-f44ab02cb2d5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:47.741140 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3b2176cb-ade9-4250-83c5-f44ab02cb2d5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:47.741705 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3b2176cb-ade9-4250-83c5-f44ab02cb2d5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:47.742668 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3b2176cb-ade9-4250-83c5-f44ab02cb2d5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:47.743301 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3b2176cb-ade9-4250-83c5-f44ab02cb2d5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:47.899361 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-3b2176cb-ade9-4250-83c5-f44ab02cb2d5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:47.917471 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-3b2176cb-ade9-4250-83c5-f44ab02cb2d5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:47.918978 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-3b2176cb-ade9-4250-83c5-f44ab02cb2d5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:47.920264 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-3b2176cb-ade9-4250-83c5-f44ab02cb2d5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1810 microversion: 2.20 time: 0.191701 Jul 14 17:57:47.920837 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 377/703] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:47 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1810 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:57:48.938375 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-5425863a-4d52-47e7-a414-dd1c659febae tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:48.939035 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-5425863a-4d52-47e7-a414-dd1c659febae tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:48.946984 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5425863a-4d52-47e7-a414-dd1c659febae tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:48.947442 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5425863a-4d52-47e7-a414-dd1c659febae tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:48.948266 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5425863a-4d52-47e7-a414-dd1c659febae tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:48.948706 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5425863a-4d52-47e7-a414-dd1c659febae tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:49.109417 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-5425863a-4d52-47e7-a414-dd1c659febae tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:49.121368 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-5425863a-4d52-47e7-a414-dd1c659febae tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:49.122987 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-5425863a-4d52-47e7-a414-dd1c659febae tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:49.124187 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-5425863a-4d52-47e7-a414-dd1c659febae tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1810 microversion: 2.20 time: 0.189991 Jul 14 17:57:49.124744 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 327/704] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:48 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1810 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:57:50.143521 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-373acddd-6688-4cca-aae4-1207e47543f4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:50.144198 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-373acddd-6688-4cca-aae4-1207e47543f4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:50.158038 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-373acddd-6688-4cca-aae4-1207e47543f4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:50.158492 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-373acddd-6688-4cca-aae4-1207e47543f4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:50.159271 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-373acddd-6688-4cca-aae4-1207e47543f4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:50.159710 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-373acddd-6688-4cca-aae4-1207e47543f4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:50.289061 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-373acddd-6688-4cca-aae4-1207e47543f4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:50.297444 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-373acddd-6688-4cca-aae4-1207e47543f4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:50.299052 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-373acddd-6688-4cca-aae4-1207e47543f4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:50.300219 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-373acddd-6688-4cca-aae4-1207e47543f4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1810 microversion: 2.20 time: 0.161459 Jul 14 17:57:50.300774 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 378/705] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:50 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:57:51.318405 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-3b6bb20b-de8e-40fd-b024-d3fe3071efc3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:51.319005 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-3b6bb20b-de8e-40fd-b024-d3fe3071efc3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:51.326350 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3b6bb20b-de8e-40fd-b024-d3fe3071efc3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:51.326793 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3b6bb20b-de8e-40fd-b024-d3fe3071efc3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:51.327578 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3b6bb20b-de8e-40fd-b024-d3fe3071efc3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:51.328045 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3b6bb20b-de8e-40fd-b024-d3fe3071efc3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:51.478220 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-3b6bb20b-de8e-40fd-b024-d3fe3071efc3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:51.487763 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-3b6bb20b-de8e-40fd-b024-d3fe3071efc3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:51.490047 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-3b6bb20b-de8e-40fd-b024-d3fe3071efc3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:51.491338 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-3b6bb20b-de8e-40fd-b024-d3fe3071efc3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1810 microversion: 2.20 time: 0.177010 Jul 14 17:57:51.491971 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 328/706] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:51 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1810 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:57:52.510720 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-6600078e-d755-4824-89bf-bc98c5af361a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:52.511348 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-6600078e-d755-4824-89bf-bc98c5af361a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:52.518080 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6600078e-d755-4824-89bf-bc98c5af361a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:52.518534 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6600078e-d755-4824-89bf-bc98c5af361a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:52.519306 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6600078e-d755-4824-89bf-bc98c5af361a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:52.520326 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6600078e-d755-4824-89bf-bc98c5af361a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:52.664175 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-6600078e-d755-4824-89bf-bc98c5af361a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:52.673154 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-6600078e-d755-4824-89bf-bc98c5af361a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:52.674640 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-6600078e-d755-4824-89bf-bc98c5af361a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:52.675804 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-6600078e-d755-4824-89bf-bc98c5af361a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1810 microversion: 2.20 time: 0.169230 Jul 14 17:57:52.677019 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 379/707] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:52 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:57:53.695798 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-89ffdf9a-c8c7-41ac-9db2-d77eb3e35717 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:53.696491 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-89ffdf9a-c8c7-41ac-9db2-d77eb3e35717 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:53.703387 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-89ffdf9a-c8c7-41ac-9db2-d77eb3e35717 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:53.703839 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-89ffdf9a-c8c7-41ac-9db2-d77eb3e35717 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:53.704651 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-89ffdf9a-c8c7-41ac-9db2-d77eb3e35717 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:53.705089 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-89ffdf9a-c8c7-41ac-9db2-d77eb3e35717 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:53.884396 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-89ffdf9a-c8c7-41ac-9db2-d77eb3e35717 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:53.895819 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-89ffdf9a-c8c7-41ac-9db2-d77eb3e35717 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:53.897414 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-89ffdf9a-c8c7-41ac-9db2-d77eb3e35717 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:53.898633 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-89ffdf9a-c8c7-41ac-9db2-d77eb3e35717 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1810 microversion: 2.20 time: 0.207266 Jul 14 17:57:53.899211 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 329/708] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:53 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1810 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:57:54.917413 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-95bb7740-0d1c-425d-ae0a-c527156bfc28 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:54.918415 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-95bb7740-0d1c-425d-ae0a-c527156bfc28 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:54.928187 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-95bb7740-0d1c-425d-ae0a-c527156bfc28 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:54.928764 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-95bb7740-0d1c-425d-ae0a-c527156bfc28 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:54.929678 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-95bb7740-0d1c-425d-ae0a-c527156bfc28 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:54.930225 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-95bb7740-0d1c-425d-ae0a-c527156bfc28 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:55.086081 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-95bb7740-0d1c-425d-ae0a-c527156bfc28 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:55.102029 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-95bb7740-0d1c-425d-ae0a-c527156bfc28 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:55.105028 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-95bb7740-0d1c-425d-ae0a-c527156bfc28 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:55.106368 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-95bb7740-0d1c-425d-ae0a-c527156bfc28 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1810 microversion: 2.20 time: 0.193463 Jul 14 17:57:55.107085 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 380/709] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:54 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1810 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:57:56.130101 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-1c48e3fb-f4c4-4b47-9650-89bd01f289c4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:56.131228 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-1c48e3fb-f4c4-4b47-9650-89bd01f289c4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:56.143451 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1c48e3fb-f4c4-4b47-9650-89bd01f289c4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:56.144290 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1c48e3fb-f4c4-4b47-9650-89bd01f289c4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:56.146172 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1c48e3fb-f4c4-4b47-9650-89bd01f289c4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:56.146968 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1c48e3fb-f4c4-4b47-9650-89bd01f289c4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:56.324408 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-1c48e3fb-f4c4-4b47-9650-89bd01f289c4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:56.334119 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-1c48e3fb-f4c4-4b47-9650-89bd01f289c4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:56.335635 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-1c48e3fb-f4c4-4b47-9650-89bd01f289c4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:56.336909 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-1c48e3fb-f4c4-4b47-9650-89bd01f289c4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1810 microversion: 2.20 time: 0.214468 Jul 14 17:57:56.337503 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 330/710] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:56 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1810 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:57:57.356826 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-45a1657a-f181-4e86-a8c1-a792a45b7d32 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:57.357750 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-45a1657a-f181-4e86-a8c1-a792a45b7d32 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:57.365506 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-45a1657a-f181-4e86-a8c1-a792a45b7d32 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:57.365954 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-45a1657a-f181-4e86-a8c1-a792a45b7d32 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:57.366761 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-45a1657a-f181-4e86-a8c1-a792a45b7d32 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:57.367202 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-45a1657a-f181-4e86-a8c1-a792a45b7d32 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:57.529206 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-45a1657a-f181-4e86-a8c1-a792a45b7d32 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:57.545888 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-45a1657a-f181-4e86-a8c1-a792a45b7d32 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:57.549255 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-45a1657a-f181-4e86-a8c1-a792a45b7d32 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:57.551610 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-45a1657a-f181-4e86-a8c1-a792a45b7d32 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1810 microversion: 2.20 time: 0.198363 Jul 14 17:57:57.562854 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 381/711] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:57 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1810 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:57:58.572151 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-86b2f255-7994-4cfc-9bbe-70b3137e427b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:58.572922 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-86b2f255-7994-4cfc-9bbe-70b3137e427b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:58.579722 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-86b2f255-7994-4cfc-9bbe-70b3137e427b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:58.580265 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-86b2f255-7994-4cfc-9bbe-70b3137e427b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:58.581087 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-86b2f255-7994-4cfc-9bbe-70b3137e427b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:58.581570 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-86b2f255-7994-4cfc-9bbe-70b3137e427b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:58.584643 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:58.728367 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-86b2f255-7994-4cfc-9bbe-70b3137e427b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:58.741142 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-86b2f255-7994-4cfc-9bbe-70b3137e427b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:58.742834 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-86b2f255-7994-4cfc-9bbe-70b3137e427b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:58.744208 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-86b2f255-7994-4cfc-9bbe-70b3137e427b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1810 microversion: 2.20 time: 0.177263 Jul 14 17:57:58.744840 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 331/712] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:58 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:57:59.763043 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-90d0b2de-2d78-4d8a-977d-338c96b194bd tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:57:59.763716 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-90d0b2de-2d78-4d8a-977d-338c96b194bd tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:57:59.771684 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-90d0b2de-2d78-4d8a-977d-338c96b194bd tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:59.772228 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-90d0b2de-2d78-4d8a-977d-338c96b194bd tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:59.773232 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-90d0b2de-2d78-4d8a-977d-338c96b194bd tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:57:59.773723 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-90d0b2de-2d78-4d8a-977d-338c96b194bd tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:57:59.934871 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-90d0b2de-2d78-4d8a-977d-338c96b194bd tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:59.945937 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-90d0b2de-2d78-4d8a-977d-338c96b194bd tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:59.947530 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-90d0b2de-2d78-4d8a-977d-338c96b194bd tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:57:59.948813 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-90d0b2de-2d78-4d8a-977d-338c96b194bd tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1810 microversion: 2.20 time: 0.190177 Jul 14 17:57:59.949405 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 382/713] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:57:59 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1810 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:58:00.967674 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-c97a0a0a-a3ef-400c-abe0-840a7f23dc4b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:58:00.968398 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-c97a0a0a-a3ef-400c-abe0-840a7f23dc4b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:00.971068 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_api:SELECT=32 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:58:00.978183 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c97a0a0a-a3ef-400c-abe0-840a7f23dc4b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:00.978737 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c97a0a0a-a3ef-400c-abe0-840a7f23dc4b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:00.979584 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c97a0a0a-a3ef-400c-abe0-840a7f23dc4b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:00.980131 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c97a0a0a-a3ef-400c-abe0-840a7f23dc4b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:01.153382 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-c97a0a0a-a3ef-400c-abe0-840a7f23dc4b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:01.163569 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-c97a0a0a-a3ef-400c-abe0-840a7f23dc4b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:01.165076 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-c97a0a0a-a3ef-400c-abe0-840a7f23dc4b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:01.166325 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-c97a0a0a-a3ef-400c-abe0-840a7f23dc4b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1810 microversion: 2.20 time: 0.202980 Jul 14 17:58:01.166917 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 332/714] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:58:00 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1810 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:58:02.184928 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-87fb78c2-f6e6-4030-8a47-68a4e23ad0eb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:58:02.185544 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-87fb78c2-f6e6-4030-8a47-68a4e23ad0eb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:02.192205 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-87fb78c2-f6e6-4030-8a47-68a4e23ad0eb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:02.193218 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-87fb78c2-f6e6-4030-8a47-68a4e23ad0eb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:02.194002 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-87fb78c2-f6e6-4030-8a47-68a4e23ad0eb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:02.194451 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-87fb78c2-f6e6-4030-8a47-68a4e23ad0eb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:02.398901 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-87fb78c2-f6e6-4030-8a47-68a4e23ad0eb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:02.410304 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-87fb78c2-f6e6-4030-8a47-68a4e23ad0eb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:02.412585 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-87fb78c2-f6e6-4030-8a47-68a4e23ad0eb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:02.413813 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-87fb78c2-f6e6-4030-8a47-68a4e23ad0eb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1810 microversion: 2.20 time: 0.232991 Jul 14 17:58:02.414392 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 383/715] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:58:02 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1810 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:58:03.437154 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-e8774af0-7430-4481-ac34-3c854054a016 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:58:03.438489 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-e8774af0-7430-4481-ac34-3c854054a016 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:03.450645 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e8774af0-7430-4481-ac34-3c854054a016 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:03.451341 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e8774af0-7430-4481-ac34-3c854054a016 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:03.452686 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e8774af0-7430-4481-ac34-3c854054a016 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:03.453360 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e8774af0-7430-4481-ac34-3c854054a016 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:03.629795 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-e8774af0-7430-4481-ac34-3c854054a016 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:03.640287 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-e8774af0-7430-4481-ac34-3c854054a016 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:03.641838 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-e8774af0-7430-4481-ac34-3c854054a016 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:03.643030 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-e8774af0-7430-4481-ac34-3c854054a016 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1810 microversion: 2.20 time: 0.213506 Jul 14 17:58:03.643596 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 333/716] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:58:03 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1810 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:58:04.662717 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-582e3b23-0530-4bd4-955c-ed24e61c13c5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:58:04.663381 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-582e3b23-0530-4bd4-955c-ed24e61c13c5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:04.673137 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-582e3b23-0530-4bd4-955c-ed24e61c13c5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:04.673854 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-582e3b23-0530-4bd4-955c-ed24e61c13c5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:04.674796 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-582e3b23-0530-4bd4-955c-ed24e61c13c5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:04.675507 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-582e3b23-0530-4bd4-955c-ed24e61c13c5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:04.822537 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-582e3b23-0530-4bd4-955c-ed24e61c13c5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:04.831450 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-582e3b23-0530-4bd4-955c-ed24e61c13c5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:04.833026 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-582e3b23-0530-4bd4-955c-ed24e61c13c5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:04.834853 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-582e3b23-0530-4bd4-955c-ed24e61c13c5 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1810 microversion: 2.20 time: 0.176771 Jul 14 17:58:04.835428 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 384/717] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:58:04 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1810 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:58:05.857773 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-6de4efec-f042-48ee-a51f-daf44b1bab0e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:58:05.858887 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-6de4efec-f042-48ee-a51f-daf44b1bab0e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:05.871255 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6de4efec-f042-48ee-a51f-daf44b1bab0e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:05.872083 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6de4efec-f042-48ee-a51f-daf44b1bab0e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:05.873535 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6de4efec-f042-48ee-a51f-daf44b1bab0e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:05.874306 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6de4efec-f042-48ee-a51f-daf44b1bab0e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:06.031430 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-6de4efec-f042-48ee-a51f-daf44b1bab0e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:06.042120 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-6de4efec-f042-48ee-a51f-daf44b1bab0e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:06.044446 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-6de4efec-f042-48ee-a51f-daf44b1bab0e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:06.045991 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-6de4efec-f042-48ee-a51f-daf44b1bab0e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1810 microversion: 2.20 time: 0.195398 Jul 14 17:58:06.046768 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 334/718] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:58:05 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1810 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:58:06.905910 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [req-42aa161e-8ad3-4381-99d4-f00a82b72484 req-a6f363ea-a2c6-447b-b964-d220ad6362f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afa45fb8-7566-483d-95ce-8f0242138b17", "name": "network-vif-plugged", "status": "completed", "tag": "babcf3c4-dfb9-4f4a-a0d8-6a98c8a91d00"}]} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:58:06.914254 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-42aa161e-8ad3-4381-99d4-f00a82b72484 req-a6f363ea-a2c6-447b-b964-d220ad6362f2 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:06.916241 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-42aa161e-8ad3-4381-99d4-f00a82b72484 req-a6f363ea-a2c6-447b-b964-d220ad6362f2 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:06.928204 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.compute.server_external_events [req-42aa161e-8ad3-4381-99d4-f00a82b72484 req-a6f363ea-a2c6-447b-b964-d220ad6362f2 service nova] Creating event network-vif-plugged:babcf3c4-dfb9-4f4a-a0d8-6a98c8a91d00 for instance afa45fb8-7566-483d-95ce-8f0242138b17 on hv-cinder-84989 Jul 14 17:58:06.933295 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [req-42aa161e-8ad3-4381-99d4-f00a82b72484 req-a6f363ea-a2c6-447b-b964-d220ad6362f2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106966 Jul 14 17:58:06.934108 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 385/719] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 17:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:58:07.065810 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-187e65cb-e55e-4230-bf66-2121d449ee83 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:58:07.066413 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-187e65cb-e55e-4230-bf66-2121d449ee83 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:07.073380 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-187e65cb-e55e-4230-bf66-2121d449ee83 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:07.073828 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-187e65cb-e55e-4230-bf66-2121d449ee83 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:07.074601 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-187e65cb-e55e-4230-bf66-2121d449ee83 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:07.075036 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-187e65cb-e55e-4230-bf66-2121d449ee83 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:07.223349 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-187e65cb-e55e-4230-bf66-2121d449ee83 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:07.233005 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-187e65cb-e55e-4230-bf66-2121d449ee83 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:07.234532 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-187e65cb-e55e-4230-bf66-2121d449ee83 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:07.235722 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-187e65cb-e55e-4230-bf66-2121d449ee83 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1810 microversion: 2.20 time: 0.174150 Jul 14 17:58:07.236327 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 335/720] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:58:07 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:58:08.256194 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-6f33547c-fea9-4c49-94fb-c151b5426584 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:58:08.258196 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-6f33547c-fea9-4c49-94fb-c151b5426584 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:08.263367 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6f33547c-fea9-4c49-94fb-c151b5426584 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:08.263776 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6f33547c-fea9-4c49-94fb-c151b5426584 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:08.264581 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6f33547c-fea9-4c49-94fb-c151b5426584 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:08.265026 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6f33547c-fea9-4c49-94fb-c151b5426584 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:08.267762 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=72 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:58:08.411181 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-6f33547c-fea9-4c49-94fb-c151b5426584 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:08.425606 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-6f33547c-fea9-4c49-94fb-c151b5426584 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:08.429250 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-6f33547c-fea9-4c49-94fb-c151b5426584 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:08.431036 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-6f33547c-fea9-4c49-94fb-c151b5426584 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1810 microversion: 2.20 time: 0.180120 Jul 14 17:58:08.431711 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 386/721] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:58:08 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1810 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:58:09.454731 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-511ecab1-0c41-4355-a165-27c56ddaaa43 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:58:09.455326 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-511ecab1-0c41-4355-a165-27c56ddaaa43 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:09.462822 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-511ecab1-0c41-4355-a165-27c56ddaaa43 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:09.463282 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-511ecab1-0c41-4355-a165-27c56ddaaa43 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:09.464151 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-511ecab1-0c41-4355-a165-27c56ddaaa43 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:09.464605 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-511ecab1-0c41-4355-a165-27c56ddaaa43 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:09.602415 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-511ecab1-0c41-4355-a165-27c56ddaaa43 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:09.611584 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-511ecab1-0c41-4355-a165-27c56ddaaa43 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:09.613181 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-511ecab1-0c41-4355-a165-27c56ddaaa43 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:09.614378 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-511ecab1-0c41-4355-a165-27c56ddaaa43 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1810 microversion: 2.20 time: 0.163599 Jul 14 17:58:09.614960 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 336/722] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:58:09 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:58:10.634190 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-e02523dc-923f-49b4-b8fc-22771090479e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:58:10.634660 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-e02523dc-923f-49b4-b8fc-22771090479e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:10.641681 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e02523dc-923f-49b4-b8fc-22771090479e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:10.642142 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e02523dc-923f-49b4-b8fc-22771090479e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:10.642934 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e02523dc-923f-49b4-b8fc-22771090479e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:10.643375 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e02523dc-923f-49b4-b8fc-22771090479e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:10.803700 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-e02523dc-923f-49b4-b8fc-22771090479e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:10.814531 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-e02523dc-923f-49b4-b8fc-22771090479e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:10.818112 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-e02523dc-923f-49b4-b8fc-22771090479e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:10.819408 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-e02523dc-923f-49b4-b8fc-22771090479e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1810 microversion: 2.20 time: 0.189818 Jul 14 17:58:10.820263 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 387/723] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:58:10 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1810 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:58:11.847768 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-53a7a752-a0ef-471e-a41e-1241ede99822 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:58:11.848729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-53a7a752-a0ef-471e-a41e-1241ede99822 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:11.860681 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-53a7a752-a0ef-471e-a41e-1241ede99822 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:11.861493 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-53a7a752-a0ef-471e-a41e-1241ede99822 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:11.862875 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-53a7a752-a0ef-471e-a41e-1241ede99822 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:11.863656 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-53a7a752-a0ef-471e-a41e-1241ede99822 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:12.020755 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-53a7a752-a0ef-471e-a41e-1241ede99822 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:12.030201 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-53a7a752-a0ef-471e-a41e-1241ede99822 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:12.031812 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-53a7a752-a0ef-471e-a41e-1241ede99822 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:12.033086 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-53a7a752-a0ef-471e-a41e-1241ede99822 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1797 microversion: 2.20 time: 0.192609 Jul 14 17:58:12.033661 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 337/724] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:58:11 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1797 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:58:33.348947 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_api:SELECT=25 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:58:33.349711 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=11 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:58:33.473031 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-723a49d5-7b27-4905-9e37-f89f2aa2117e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6bf5efd0-ce3f-4821-ada4-7098cda143e6"}} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:58:33.474182 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-723a49d5-7b27-4905-9e37-f89f2aa2117e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:33.480221 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-723a49d5-7b27-4905-9e37-f89f2aa2117e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:33.480677 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-723a49d5-7b27-4905-9e37-f89f2aa2117e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:33.481570 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-723a49d5-7b27-4905-9e37-f89f2aa2117e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:33.482656 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-723a49d5-7b27-4905-9e37-f89f2aa2117e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:33.751770 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-723a49d5-7b27-4905-9e37-f89f2aa2117e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "POST /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.407422 Jul 14 17:58:33.752485 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 388/725] 10.222.0.64 () {60 vars in 1322 bytes} [Thu Jul 14 17:58:33 2022] POST /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6/os-volume_attachments => generated 194 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 17:58:41.278135 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-fbe7b745-baaf-4475-82c8-fdab39a76b35 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:58:41.279110 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-fbe7b745-baaf-4475-82c8-fdab39a76b35 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:41.281440 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_api:SELECT=11 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:58:41.282098 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=41 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:58:41.288764 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fbe7b745-baaf-4475-82c8-fdab39a76b35 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:41.289218 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fbe7b745-baaf-4475-82c8-fdab39a76b35 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:41.290001 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fbe7b745-baaf-4475-82c8-fdab39a76b35 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:41.290441 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fbe7b745-baaf-4475-82c8-fdab39a76b35 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:41.314956 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.objects.instance [None req-fbe7b745-baaf-4475-82c8-fdab39a76b35 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lazy-loading 'flavor' on Instance uuid baa9b44b-200c-4ce7-8026-630090c848b6 {{(pid=129470) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 17:58:41.445583 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-fbe7b745-baaf-4475-82c8-fdab39a76b35 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "POST /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6/action" status: 200 len: 32 microversion: 2.1 time: 0.171340 Jul 14 17:58:41.446314 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 338/726] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Jul 14 17:58:41 2022] POST /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6/action => generated 32 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 17:58:41.457079 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-01e0ff07-2352-4421-b375-5e7dbf1b9e1a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:58:41.457840 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-01e0ff07-2352-4421-b375-5e7dbf1b9e1a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:41.466133 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-01e0ff07-2352-4421-b375-5e7dbf1b9e1a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:41.466815 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-01e0ff07-2352-4421-b375-5e7dbf1b9e1a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:41.468604 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-01e0ff07-2352-4421-b375-5e7dbf1b9e1a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:41.469066 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-01e0ff07-2352-4421-b375-5e7dbf1b9e1a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:41.607106 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-01e0ff07-2352-4421-b375-5e7dbf1b9e1a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:41.616190 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-01e0ff07-2352-4421-b375-5e7dbf1b9e1a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 200 len: 1734 microversion: 2.1 time: 0.163961 Jul 14 17:58:41.616783 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 389/727] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:58:41 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:58:42.634558 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-ecd1f09f-062d-4c37-903f-976aefd05f5a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:58:42.635247 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-ecd1f09f-062d-4c37-903f-976aefd05f5a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:42.641496 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ecd1f09f-062d-4c37-903f-976aefd05f5a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:42.641942 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ecd1f09f-062d-4c37-903f-976aefd05f5a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:42.642695 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ecd1f09f-062d-4c37-903f-976aefd05f5a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:42.643127 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ecd1f09f-062d-4c37-903f-976aefd05f5a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:42.776612 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-ecd1f09f-062d-4c37-903f-976aefd05f5a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:42.785465 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-ecd1f09f-062d-4c37-903f-976aefd05f5a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 200 len: 1734 microversion: 2.1 time: 0.155523 Jul 14 17:58:42.786081 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 339/728] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:58:42 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:58:43.805561 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-4eb96da8-8be9-4ce1-90f3-562d51c6489f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:58:43.806163 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-4eb96da8-8be9-4ce1-90f3-562d51c6489f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:43.812912 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4eb96da8-8be9-4ce1-90f3-562d51c6489f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:43.813365 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4eb96da8-8be9-4ce1-90f3-562d51c6489f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:43.814146 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4eb96da8-8be9-4ce1-90f3-562d51c6489f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:43.814583 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4eb96da8-8be9-4ce1-90f3-562d51c6489f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:43.947893 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-4eb96da8-8be9-4ce1-90f3-562d51c6489f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:43.956608 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-4eb96da8-8be9-4ce1-90f3-562d51c6489f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 200 len: 1734 microversion: 2.1 time: 0.155307 Jul 14 17:58:43.957206 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 390/729] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:58:43 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:58:44.974243 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-1b85ac05-7698-4c2d-b094-9023358dbd6d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:58:44.974851 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-1b85ac05-7698-4c2d-b094-9023358dbd6d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:44.981803 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1b85ac05-7698-4c2d-b094-9023358dbd6d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:44.982258 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1b85ac05-7698-4c2d-b094-9023358dbd6d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:44.983537 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1b85ac05-7698-4c2d-b094-9023358dbd6d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:44.983999 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1b85ac05-7698-4c2d-b094-9023358dbd6d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:45.126951 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-1b85ac05-7698-4c2d-b094-9023358dbd6d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:45.135865 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-1b85ac05-7698-4c2d-b094-9023358dbd6d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 200 len: 1734 microversion: 2.1 time: 0.165416 Jul 14 17:58:45.136526 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 340/730] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:58:44 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:58:46.153104 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-d6db78e5-20d2-4206-8f79-28056191f2b2 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:58:46.153710 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-d6db78e5-20d2-4206-8f79-28056191f2b2 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:46.160169 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d6db78e5-20d2-4206-8f79-28056191f2b2 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:46.160623 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d6db78e5-20d2-4206-8f79-28056191f2b2 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:46.161397 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d6db78e5-20d2-4206-8f79-28056191f2b2 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:46.161857 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d6db78e5-20d2-4206-8f79-28056191f2b2 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:46.534852 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-d6db78e5-20d2-4206-8f79-28056191f2b2 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:46.543044 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-d6db78e5-20d2-4206-8f79-28056191f2b2 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 200 len: 1734 microversion: 2.1 time: 0.393683 Jul 14 17:58:46.543626 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 391/731] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:58:46 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 1734 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:58:47.175294 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-f371d549-0b46-437c-856e-b7d806c6a070 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:58:47.175841 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-f371d549-0b46-437c-856e-b7d806c6a070 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:47.182406 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f371d549-0b46-437c-856e-b7d806c6a070 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:47.182807 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f371d549-0b46-437c-856e-b7d806c6a070 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:47.183579 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f371d549-0b46-437c-856e-b7d806c6a070 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:47.184058 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f371d549-0b46-437c-856e-b7d806c6a070 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:47.306949 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.objects.instance [None req-f371d549-0b46-437c-856e-b7d806c6a070 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lazy-loading 'services' on Instance uuid 1e8e31fc-eea3-4666-90e3-1898f92cf6ba {{(pid=129470) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 17:58:47.418778 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-f371d549-0b46-437c-856e-b7d806c6a070 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "DELETE /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba/os-volume_attachments/3933978e-abcb-425b-aa40-1397e2ec448a" status: 202 len: 0 microversion: 2.1 time: 0.247271 Jul 14 17:58:47.419381 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 341/732] 10.222.0.64 () {58 vars in 1415 bytes} [Thu Jul 14 17:58:47 2022] DELETE /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba/os-volume_attachments/3933978e-abcb-425b-aa40-1397e2ec448a => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 17:58:47.561786 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-c168298f-4142-4c75-be1b-08a98aca442d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:58:47.562415 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-c168298f-4142-4c75-be1b-08a98aca442d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:47.569180 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c168298f-4142-4c75-be1b-08a98aca442d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:47.569927 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c168298f-4142-4c75-be1b-08a98aca442d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:47.570719 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c168298f-4142-4c75-be1b-08a98aca442d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:47.571161 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c168298f-4142-4c75-be1b-08a98aca442d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:47.704441 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-c168298f-4142-4c75-be1b-08a98aca442d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:47.712791 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-c168298f-4142-4c75-be1b-08a98aca442d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 200 len: 1734 microversion: 2.1 time: 0.155199 Jul 14 17:58:47.713540 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 392/733] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:58:47 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:58:48.545791 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-101c4edd-a649-4761-9f4d-c1259b4b408f tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:58:48.552903 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-101c4edd-a649-4761-9f4d-c1259b4b408f tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:48.553375 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-101c4edd-a649-4761-9f4d-c1259b4b408f tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:48.574437 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-101c4edd-a649-4761-9f4d-c1259b4b408f tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Going to try to stop instance {{(pid=129470) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 17:58:48.617200 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-101c4edd-a649-4761-9f4d-c1259b4b408f tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "POST /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba/action" status: 202 len: 0 microversion: 2.1 time: 0.076138 Jul 14 17:58:48.617792 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 342/734] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Jul 14 17:58:48 2022] POST /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 17:58:48.625853 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-7afc9476-2c28-4f99-8d4e-d7b10f740565 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:58:48.626473 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-7afc9476-2c28-4f99-8d4e-d7b10f740565 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:48.632943 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7afc9476-2c28-4f99-8d4e-d7b10f740565 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:48.633451 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7afc9476-2c28-4f99-8d4e-d7b10f740565 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:48.634419 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7afc9476-2c28-4f99-8d4e-d7b10f740565 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:48.634902 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7afc9476-2c28-4f99-8d4e-d7b10f740565 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:48.730974 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-68fffd8c-36a3-4857-8841-a2900a0a416b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:58:48.731677 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-68fffd8c-36a3-4857-8841-a2900a0a416b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:48.738060 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-68fffd8c-36a3-4857-8841-a2900a0a416b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:48.738560 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-68fffd8c-36a3-4857-8841-a2900a0a416b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:48.739303 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-68fffd8c-36a3-4857-8841-a2900a0a416b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:48.740117 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-68fffd8c-36a3-4857-8841-a2900a0a416b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:48.771504 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-7afc9476-2c28-4f99-8d4e-d7b10f740565 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:48.783131 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-7afc9476-2c28-4f99-8d4e-d7b10f740565 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1676 microversion: 2.1 time: 0.160073 Jul 14 17:58:48.783131 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 393/735] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:58:48 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:58:48.817746 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 17:58:48.818033 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Thu Jul 14 17:58:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 (ip 10.222.0.64) !!! Jul 14 17:58:48.872566 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-68fffd8c-36a3-4857-8841-a2900a0a416b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:48.882129 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-68fffd8c-36a3-4857-8841-a2900a0a416b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 200 len: 1734 microversion: 2.1 time: 0.155225 Jul 14 17:58:48.882850 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 343/736] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:58:48 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:58:49.798602 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-3d5e3d03-27b2-4fde-b879-e1c20d919a6a tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:58:49.799211 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-3d5e3d03-27b2-4fde-b879-e1c20d919a6a tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:49.806451 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3d5e3d03-27b2-4fde-b879-e1c20d919a6a tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:49.806906 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3d5e3d03-27b2-4fde-b879-e1c20d919a6a tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:49.807766 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3d5e3d03-27b2-4fde-b879-e1c20d919a6a tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:49.808240 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3d5e3d03-27b2-4fde-b879-e1c20d919a6a tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:49.899853 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-0a7f2022-b454-4a47-bf35-fdffbfabcdc5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:58:49.900596 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-0a7f2022-b454-4a47-bf35-fdffbfabcdc5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:49.907298 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0a7f2022-b454-4a47-bf35-fdffbfabcdc5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:49.907817 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0a7f2022-b454-4a47-bf35-fdffbfabcdc5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:49.908687 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0a7f2022-b454-4a47-bf35-fdffbfabcdc5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:49.909187 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0a7f2022-b454-4a47-bf35-fdffbfabcdc5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:49.940379 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-3d5e3d03-27b2-4fde-b879-e1c20d919a6a tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:49.948035 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-3d5e3d03-27b2-4fde-b879-e1c20d919a6a tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1676 microversion: 2.1 time: 0.153292 Jul 14 17:58:49.948626 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 394/737] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:58:49 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:58:50.042558 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-0a7f2022-b454-4a47-bf35-fdffbfabcdc5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:50.050776 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-0a7f2022-b454-4a47-bf35-fdffbfabcdc5 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 200 len: 1734 microversion: 2.1 time: 0.154590 Jul 14 17:58:50.051346 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 344/738] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:58:49 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:58:50.966492 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-97fbb070-a007-43db-b969-ca32dc57587d tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:58:50.967132 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-97fbb070-a007-43db-b969-ca32dc57587d tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:50.974077 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-97fbb070-a007-43db-b969-ca32dc57587d tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:50.974524 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-97fbb070-a007-43db-b969-ca32dc57587d tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:50.975295 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-97fbb070-a007-43db-b969-ca32dc57587d tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:50.975735 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-97fbb070-a007-43db-b969-ca32dc57587d tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:51.068725 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-3343d5d0-2e5a-494b-8948-bd7f73ec9d27 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:58:51.069347 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-3343d5d0-2e5a-494b-8948-bd7f73ec9d27 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:51.076181 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3343d5d0-2e5a-494b-8948-bd7f73ec9d27 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:51.076703 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3343d5d0-2e5a-494b-8948-bd7f73ec9d27 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:51.077442 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3343d5d0-2e5a-494b-8948-bd7f73ec9d27 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:51.077874 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3343d5d0-2e5a-494b-8948-bd7f73ec9d27 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:51.111349 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-97fbb070-a007-43db-b969-ca32dc57587d tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:51.121901 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-97fbb070-a007-43db-b969-ca32dc57587d tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1676 microversion: 2.1 time: 0.158790 Jul 14 17:58:51.122949 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 395/739] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:58:50 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:58:51.235064 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-3343d5d0-2e5a-494b-8948-bd7f73ec9d27 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:51.243214 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-3343d5d0-2e5a-494b-8948-bd7f73ec9d27 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 200 len: 1734 microversion: 2.1 time: 0.178369 Jul 14 17:58:51.243774 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 345/740] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:58:51 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 1734 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:58:52.145452 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-cde04c62-405a-402b-afe8-89e56c7f95b2 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:58:52.146055 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-cde04c62-405a-402b-afe8-89e56c7f95b2 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:52.153879 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-cde04c62-405a-402b-afe8-89e56c7f95b2 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:52.154323 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-cde04c62-405a-402b-afe8-89e56c7f95b2 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:52.155095 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-cde04c62-405a-402b-afe8-89e56c7f95b2 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:52.155589 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-cde04c62-405a-402b-afe8-89e56c7f95b2 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:52.260999 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-6dce05fc-3c3d-4fec-bf32-1e80fa8d2cba tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:58:52.261781 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-6dce05fc-3c3d-4fec-bf32-1e80fa8d2cba tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:52.269377 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6dce05fc-3c3d-4fec-bf32-1e80fa8d2cba tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:52.269836 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6dce05fc-3c3d-4fec-bf32-1e80fa8d2cba tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:52.270615 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6dce05fc-3c3d-4fec-bf32-1e80fa8d2cba tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:52.271065 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6dce05fc-3c3d-4fec-bf32-1e80fa8d2cba tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:52.290127 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-cde04c62-405a-402b-afe8-89e56c7f95b2 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:52.298072 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-cde04c62-405a-402b-afe8-89e56c7f95b2 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1676 microversion: 2.1 time: 0.156573 Jul 14 17:58:52.298645 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 396/741] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:58:52 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:58:52.411216 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-6dce05fc-3c3d-4fec-bf32-1e80fa8d2cba tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:52.419720 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-6dce05fc-3c3d-4fec-bf32-1e80fa8d2cba tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 200 len: 1734 microversion: 2.1 time: 0.163105 Jul 14 17:58:52.420344 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 346/742] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:58:52 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:58:53.315347 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-21fde41d-7672-4046-ba34-daa2277d61a7 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:58:53.316014 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-21fde41d-7672-4046-ba34-daa2277d61a7 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:53.322461 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-21fde41d-7672-4046-ba34-daa2277d61a7 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:53.322915 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-21fde41d-7672-4046-ba34-daa2277d61a7 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:53.323684 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-21fde41d-7672-4046-ba34-daa2277d61a7 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:53.324158 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-21fde41d-7672-4046-ba34-daa2277d61a7 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:53.438036 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-30804d3e-f3ef-4b00-86c5-71404b5bd31e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:58:53.438649 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-30804d3e-f3ef-4b00-86c5-71404b5bd31e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:53.445206 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-30804d3e-f3ef-4b00-86c5-71404b5bd31e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:53.445659 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-30804d3e-f3ef-4b00-86c5-71404b5bd31e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:53.446474 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-30804d3e-f3ef-4b00-86c5-71404b5bd31e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:53.446916 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-30804d3e-f3ef-4b00-86c5-71404b5bd31e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:53.455269 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-21fde41d-7672-4046-ba34-daa2277d61a7 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:53.462267 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-21fde41d-7672-4046-ba34-daa2277d61a7 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1676 microversion: 2.1 time: 0.150742 Jul 14 17:58:53.462843 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 397/743] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:58:53 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:58:53.582339 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-30804d3e-f3ef-4b00-86c5-71404b5bd31e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:53.590742 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-30804d3e-f3ef-4b00-86c5-71404b5bd31e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 200 len: 1734 microversion: 2.1 time: 0.157119 Jul 14 17:58:53.591318 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 347/744] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:58:53 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:58:54.480379 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-22a9258a-8d14-4dec-af04-7df1d15e31d7 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:58:54.481039 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-22a9258a-8d14-4dec-af04-7df1d15e31d7 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:54.488243 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-22a9258a-8d14-4dec-af04-7df1d15e31d7 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:54.488856 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-22a9258a-8d14-4dec-af04-7df1d15e31d7 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:54.489640 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-22a9258a-8d14-4dec-af04-7df1d15e31d7 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:54.490076 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-22a9258a-8d14-4dec-af04-7df1d15e31d7 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:54.609536 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-d6cd0d96-fbd8-4e66-8c63-c4d1b1bb9ac8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:58:54.610163 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-d6cd0d96-fbd8-4e66-8c63-c4d1b1bb9ac8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:54.616787 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d6cd0d96-fbd8-4e66-8c63-c4d1b1bb9ac8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:54.617243 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d6cd0d96-fbd8-4e66-8c63-c4d1b1bb9ac8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:54.618055 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d6cd0d96-fbd8-4e66-8c63-c4d1b1bb9ac8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:54.618546 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d6cd0d96-fbd8-4e66-8c63-c4d1b1bb9ac8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:54.622361 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-22a9258a-8d14-4dec-af04-7df1d15e31d7 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:54.631063 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-22a9258a-8d14-4dec-af04-7df1d15e31d7 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1676 microversion: 2.1 time: 0.154799 Jul 14 17:58:54.631957 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 398/745] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:58:54 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:58:54.777385 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-d6cd0d96-fbd8-4e66-8c63-c4d1b1bb9ac8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:54.785813 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-d6cd0d96-fbd8-4e66-8c63-c4d1b1bb9ac8 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 200 len: 1734 microversion: 2.1 time: 0.181279 Jul 14 17:58:54.786415 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 348/746] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:58:54 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 1734 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:58:55.648413 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-1501624f-a820-4fda-bb24-9798dfc9ee62 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:58:55.649029 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-1501624f-a820-4fda-bb24-9798dfc9ee62 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:55.656225 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1501624f-a820-4fda-bb24-9798dfc9ee62 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:55.656680 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1501624f-a820-4fda-bb24-9798dfc9ee62 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:55.657467 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1501624f-a820-4fda-bb24-9798dfc9ee62 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:55.657900 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1501624f-a820-4fda-bb24-9798dfc9ee62 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:55.803680 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-60773ef8-e3c0-4ab4-a440-e3a24f13048e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:58:55.804753 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-60773ef8-e3c0-4ab4-a440-e3a24f13048e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:55.811337 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-1501624f-a820-4fda-bb24-9798dfc9ee62 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:55.812588 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-60773ef8-e3c0-4ab4-a440-e3a24f13048e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:55.813048 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-60773ef8-e3c0-4ab4-a440-e3a24f13048e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:55.813840 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-60773ef8-e3c0-4ab4-a440-e3a24f13048e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:55.814281 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-60773ef8-e3c0-4ab4-a440-e3a24f13048e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:55.826481 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-1501624f-a820-4fda-bb24-9798dfc9ee62 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1676 microversion: 2.1 time: 0.181229 Jul 14 17:58:55.828427 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 399/747] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:58:55 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1676 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:58:55.954176 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-60773ef8-e3c0-4ab4-a440-e3a24f13048e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:55.962553 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-60773ef8-e3c0-4ab4-a440-e3a24f13048e tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 200 len: 1734 microversion: 2.1 time: 0.163315 Jul 14 17:58:55.963140 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 349/748] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:58:55 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:58:56.851015 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-8b949435-b18d-4634-a1b2-6ff2ace0b627 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:58:56.851648 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-8b949435-b18d-4634-a1b2-6ff2ace0b627 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:56.858408 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8b949435-b18d-4634-a1b2-6ff2ace0b627 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:56.858859 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8b949435-b18d-4634-a1b2-6ff2ace0b627 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:56.859649 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8b949435-b18d-4634-a1b2-6ff2ace0b627 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:56.860195 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8b949435-b18d-4634-a1b2-6ff2ace0b627 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:56.980366 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-9c197bc0-a36d-40a5-9a3f-1a1b541ffe9d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:58:56.981140 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-9c197bc0-a36d-40a5-9a3f-1a1b541ffe9d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:56.988046 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9c197bc0-a36d-40a5-9a3f-1a1b541ffe9d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:56.988501 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9c197bc0-a36d-40a5-9a3f-1a1b541ffe9d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:56.989296 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9c197bc0-a36d-40a5-9a3f-1a1b541ffe9d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:56.989738 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9c197bc0-a36d-40a5-9a3f-1a1b541ffe9d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:57.004838 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-8b949435-b18d-4634-a1b2-6ff2ace0b627 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:57.012805 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-8b949435-b18d-4634-a1b2-6ff2ace0b627 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1676 microversion: 2.1 time: 0.165786 Jul 14 17:58:57.013395 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 400/749] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:58:56 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:58:57.135018 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-9c197bc0-a36d-40a5-9a3f-1a1b541ffe9d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:57.138470 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:58:57.145029 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-9c197bc0-a36d-40a5-9a3f-1a1b541ffe9d tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 200 len: 1714 microversion: 2.1 time: 0.168372 Jul 14 17:58:57.145758 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 350/750] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:58:56 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 1714 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:58:57.203443 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-7829721d-f4a9-4c78-9423-9b18c13f9cb9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:58:57.204257 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-7829721d-f4a9-4c78-9423-9b18c13f9cb9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:57.210522 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7829721d-f4a9-4c78-9423-9b18c13f9cb9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:57.210980 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7829721d-f4a9-4c78-9423-9b18c13f9cb9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:57.211766 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7829721d-f4a9-4c78-9423-9b18c13f9cb9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:57.212241 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7829721d-f4a9-4c78-9423-9b18c13f9cb9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:57.354262 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.wsgi [None req-7829721d-f4a9-4c78-9423-9b18c13f9cb9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] HTTP exception thrown: Cannot 'detach_volume' instance baa9b44b-200c-4ce7-8026-630090c848b6 while it is in vm_state rescued Jul 14 17:58:57.357650 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-7829721d-f4a9-4c78-9423-9b18c13f9cb9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Request method failure captured: Jul 14 17:58:57.357650 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: request: DELETE /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6/os-volume_attachments/6bf5efd0-ce3f-4821-ada4-7098cda143e6 HTTP/1.1 Jul 14 17:58:57.357650 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept: application/json Jul 14 17:58:57.357650 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept-Encoding: identity Jul 14 17:58:57.357650 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Connection: close Jul 14 17:58:57.357650 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Length: 0 Jul 14 17:58:57.357650 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Type: application/json Jul 14 17:58:57.357650 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Host: 10.222.0.64 Jul 14 17:58:57.357650 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Openstack-System-Scope: None Jul 14 17:58:57.357650 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: User-Agent: python-urllib3/1.26.9 Jul 14 17:58:57.357650 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Auth-Token: gAAAAABi0FfL6emn5hg2SNahQObVYYShIrtH-f3Fd-CAp1ihyP3qn1qpxmH7972vS_WzpDPVTAyMR2SXNmzXKBpQQN8nUKpUEX5KNrSOtzqNYhKbT7o6DhLBkpLmyAxCB9QiIEyoBCjGxn1ftlUyU7aDfEm3oaSulrngFZzD1cGUryIY_p8LWw4 Jul 14 17:58:57.357650 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Id: None Jul 14 17:58:57.357650 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Name: None Jul 14 17:58:57.357650 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Identity-Status: Confirmed Jul 14 17:58:57.357650 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Is-Admin-Project: True Jul 14 17:58:57.357650 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Id: default Jul 14 17:58:57.357650 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Name: Default Jul 14 17:58:57.357650 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Id: ab58d5c4c0194b58ad47dd5e4494389f Jul 14 17:58:57.357650 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-763337508 Jul 14 17:58:57.357650 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Role: reader,member Jul 14 17:58:57.357650 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Roles: reader,member Jul 14 17:58:57.359136 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ab58d5c4c0194b58ad47dd5e4494389f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ab58d5c4c0194b58ad47dd5e4494389f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ab58d5c4c0194b58ad47dd5e4494389f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ab58d5c4c0194b58ad47dd5e4494389f", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 17:58:57.359136 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant: tempest-ServerRescueNegativeTestJSON-763337508 Jul 14 17:58:57.359136 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Id: ab58d5c4c0194b58ad47dd5e4494389f Jul 14 17:58:57.359136 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-763337508 Jul 14 17:58:57.359136 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User: tempest-ServerRescueNegativeTestJSON-763337508-project Jul 14 17:58:57.359136 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Id: default Jul 14 17:58:57.359136 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Name: Default Jul 14 17:58:57.359136 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Id: 52c794c11ab74f9ca9bad75857043a62 Jul 14 17:58:57.359136 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Name: tempest-ServerRescueNegativeTestJSON-763337508-project Jul 14 17:58:57.359136 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: method: > Jul 14 17:58:57.359136 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: exception: Cannot 'detach_volume' instance baa9b44b-200c-4ce7-8026-630090c848b6 while it is in vm_state rescued Jul 14 17:58:57.359864 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: action_args: {'server_id': 'baa9b44b-200c-4ce7-8026-630090c848b6', 'id': '6bf5efd0-ce3f-4821-ada4-7098cda143e6'} Jul 14 17:58:57.359864 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 17:58:57.359864 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:58:57.359864 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 17:58:57.359864 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 17:58:57.359864 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 17:58:57.359864 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 17:58:57.359864 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 17:58:57.359864 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 17:58:57.359864 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance baa9b44b-200c-4ce7-8026-630090c848b6 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 14 17:58:57.359864 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:58:57.359864 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:58:57.359864 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:58:57.359864 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:58:57.359864 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:58:57.359864 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:58:57.359864 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 17:58:57.359864 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 17:58:57.359864 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 17:58:57.359864 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 17:58:57.361310 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 14 17:58:57.361310 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 17:58:57.361310 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 17:58:57.361310 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 17:58:57.361310 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance baa9b44b-200c-4ce7-8026-630090c848b6 while it is in vm_state rescued Jul 14 17:58:57.361310 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:58:57.361310 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:58:57.361310 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:58:57.361310 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:58:57.361310 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:58:57.361310 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:58:57.361310 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 17:58:57.361310 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 17:58:57.361310 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance baa9b44b-200c-4ce7-8026-630090c848b6 while it is in vm_state rescued Jul 14 17:58:57.361310 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 17:58:57.361310 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-7829721d-f4a9-4c78-9423-9b18c13f9cb9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Returning 409 to user: Cannot 'detach_volume' instance baa9b44b-200c-4ce7-8026-630090c848b6 while it is in vm_state rescued {{(pid=129471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 17:58:57.362349 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-7829721d-f4a9-4c78-9423-9b18c13f9cb9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "DELETE /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6/os-volume_attachments/6bf5efd0-ce3f-4821-ada4-7098cda143e6" status: 409 len: 152 microversion: 2.1 time: 0.161406 Jul 14 17:58:57.366475 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 401/751] 10.222.0.64 () {58 vars in 1415 bytes} [Thu Jul 14 17:58:57 2022] DELETE /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6/os-volume_attachments/6bf5efd0-ce3f-4821-ada4-7098cda143e6 => generated 152 bytes in 168 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 17:58:57.373694 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-4e5a402e-c456-44be-92be-0b2ad8340989 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:58:57.374862 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-4e5a402e-c456-44be-92be-0b2ad8340989 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:57.382612 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4e5a402e-c456-44be-92be-0b2ad8340989 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:57.383197 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4e5a402e-c456-44be-92be-0b2ad8340989 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:57.384058 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4e5a402e-c456-44be-92be-0b2ad8340989 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:57.384505 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4e5a402e-c456-44be-92be-0b2ad8340989 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:57.459074 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-4e5a402e-c456-44be-92be-0b2ad8340989 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "POST /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6/action" status: 202 len: 0 microversion: 2.1 time: 0.090551 Jul 14 17:58:57.459750 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 351/752] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Jul 14 17:58:57 2022] POST /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 17:58:57.468229 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-1d733902-63dd-44bf-b349-816636678b49 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:58:57.468849 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-1d733902-63dd-44bf-b349-816636678b49 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:57.476159 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1d733902-63dd-44bf-b349-816636678b49 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:57.476615 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1d733902-63dd-44bf-b349-816636678b49 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:57.477415 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1d733902-63dd-44bf-b349-816636678b49 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:57.477859 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1d733902-63dd-44bf-b349-816636678b49 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:57.620947 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-1d733902-63dd-44bf-b349-816636678b49 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:57.629990 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-1d733902-63dd-44bf-b349-816636678b49 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 200 len: 1722 microversion: 2.1 time: 0.165755 Jul 14 17:58:57.630579 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 402/753] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:58:57 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:58:58.036490 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-a5613a69-af4e-4211-a709-24b06795b98c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:58:58.037246 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-a5613a69-af4e-4211-a709-24b06795b98c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:58.043436 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a5613a69-af4e-4211-a709-24b06795b98c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:58.044379 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a5613a69-af4e-4211-a709-24b06795b98c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:58.044703 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a5613a69-af4e-4211-a709-24b06795b98c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:58.045143 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a5613a69-af4e-4211-a709-24b06795b98c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:58.183474 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-a5613a69-af4e-4211-a709-24b06795b98c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:58.191522 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-a5613a69-af4e-4211-a709-24b06795b98c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1676 microversion: 2.1 time: 0.162546 Jul 14 17:58:58.192163 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 352/754] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:58:58 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:58:58.647970 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-fb3ac9fd-76bb-4845-bb17-142222cfe6a6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:58:58.648592 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-fb3ac9fd-76bb-4845-bb17-142222cfe6a6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:58.656218 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fb3ac9fd-76bb-4845-bb17-142222cfe6a6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:58.656678 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fb3ac9fd-76bb-4845-bb17-142222cfe6a6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:58.657481 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fb3ac9fd-76bb-4845-bb17-142222cfe6a6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:58.657922 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fb3ac9fd-76bb-4845-bb17-142222cfe6a6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:58.662512 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:58:58.806750 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-fb3ac9fd-76bb-4845-bb17-142222cfe6a6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:58.815711 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-fb3ac9fd-76bb-4845-bb17-142222cfe6a6 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 200 len: 1722 microversion: 2.1 time: 0.171665 Jul 14 17:58:58.816351 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 403/755] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:58:58 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:58:59.209325 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-4e8a2d11-6bba-4f53-b5ac-1e5e7ea542ce tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:58:59.209952 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-4e8a2d11-6bba-4f53-b5ac-1e5e7ea542ce tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:59.217100 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4e8a2d11-6bba-4f53-b5ac-1e5e7ea542ce tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:59.217608 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4e8a2d11-6bba-4f53-b5ac-1e5e7ea542ce tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:59.218437 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4e8a2d11-6bba-4f53-b5ac-1e5e7ea542ce tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:59.218925 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4e8a2d11-6bba-4f53-b5ac-1e5e7ea542ce tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:59.378789 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-4e8a2d11-6bba-4f53-b5ac-1e5e7ea542ce tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:59.387170 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-4e8a2d11-6bba-4f53-b5ac-1e5e7ea542ce tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1653 microversion: 2.1 time: 0.181754 Jul 14 17:58:59.387781 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 353/756] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:58:59 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1653 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:58:59.416182 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-b0c04295-af44-4504-9111-024130010504 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:58:59.426538 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b0c04295-af44-4504-9111-024130010504 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:59.427243 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b0c04295-af44-4504-9111-024130010504 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:59.454650 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-b0c04295-af44-4504-9111-024130010504 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Going to try to start instance {{(pid=129471) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 14 17:58:59.502777 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-b0c04295-af44-4504-9111-024130010504 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "POST /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba/action" status: 202 len: 0 microversion: 2.1 time: 0.093424 Jul 14 17:58:59.503396 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 404/757] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Jul 14 17:58:59 2022] POST /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 17:58:59.512270 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-5cee09b5-c471-4f47-a347-80b297178247 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:58:59.513044 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-5cee09b5-c471-4f47-a347-80b297178247 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:59.524060 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5cee09b5-c471-4f47-a347-80b297178247 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:59.524512 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5cee09b5-c471-4f47-a347-80b297178247 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:59.525310 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5cee09b5-c471-4f47-a347-80b297178247 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:59.525747 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5cee09b5-c471-4f47-a347-80b297178247 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:59.666335 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-5cee09b5-c471-4f47-a347-80b297178247 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:59.674294 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-5cee09b5-c471-4f47-a347-80b297178247 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1662 microversion: 2.1 time: 0.166442 Jul 14 17:58:59.674893 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 354/758] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:58:59 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1662 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:58:59.833991 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-b8c21003-2326-4959-ade5-d92c5dd1a2e2 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:58:59.834698 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-b8c21003-2326-4959-ade5-d92c5dd1a2e2 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:58:59.841167 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b8c21003-2326-4959-ade5-d92c5dd1a2e2 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:59.841622 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b8c21003-2326-4959-ade5-d92c5dd1a2e2 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:59.842396 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b8c21003-2326-4959-ade5-d92c5dd1a2e2 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:58:59.842836 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b8c21003-2326-4959-ade5-d92c5dd1a2e2 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:58:59.986401 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-b8c21003-2326-4959-ade5-d92c5dd1a2e2 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:58:59.994874 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-b8c21003-2326-4959-ade5-d92c5dd1a2e2 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 200 len: 1722 microversion: 2.1 time: 0.165500 Jul 14 17:58:59.995478 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 405/759] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:58:59 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:59:00.692067 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-3b28c56a-141d-4313-986c-be7fd8cd5c40 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:00.692739 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-3b28c56a-141d-4313-986c-be7fd8cd5c40 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:00.699691 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3b28c56a-141d-4313-986c-be7fd8cd5c40 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:00.700173 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3b28c56a-141d-4313-986c-be7fd8cd5c40 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:00.700973 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3b28c56a-141d-4313-986c-be7fd8cd5c40 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:00.701443 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3b28c56a-141d-4313-986c-be7fd8cd5c40 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:00.836653 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-3b28c56a-141d-4313-986c-be7fd8cd5c40 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:00.844435 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-3b28c56a-141d-4313-986c-be7fd8cd5c40 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1662 microversion: 2.1 time: 0.156259 Jul 14 17:59:00.845277 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 355/760] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:00 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1662 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:59:01.014031 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-a75afad8-3a4a-4dcb-818e-7c156744d1ad tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:01.014700 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-a75afad8-3a4a-4dcb-818e-7c156744d1ad tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:01.022345 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a75afad8-3a4a-4dcb-818e-7c156744d1ad tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:01.022804 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a75afad8-3a4a-4dcb-818e-7c156744d1ad tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:01.023615 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a75afad8-3a4a-4dcb-818e-7c156744d1ad tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:01.024098 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a75afad8-3a4a-4dcb-818e-7c156744d1ad tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:01.177814 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-a75afad8-3a4a-4dcb-818e-7c156744d1ad tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:01.195165 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-a75afad8-3a4a-4dcb-818e-7c156744d1ad tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 200 len: 1722 microversion: 2.1 time: 0.184920 Jul 14 17:59:01.195775 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 406/761] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:01 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:59:01.862272 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-7c8401a2-e20e-4b46-aab8-83162db95a8e tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:01.863055 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-7c8401a2-e20e-4b46-aab8-83162db95a8e tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:01.869344 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7c8401a2-e20e-4b46-aab8-83162db95a8e tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:01.869789 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7c8401a2-e20e-4b46-aab8-83162db95a8e tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:01.870568 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7c8401a2-e20e-4b46-aab8-83162db95a8e tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:01.871003 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7c8401a2-e20e-4b46-aab8-83162db95a8e tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:02.026557 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-7c8401a2-e20e-4b46-aab8-83162db95a8e tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:02.034852 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-7c8401a2-e20e-4b46-aab8-83162db95a8e tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1662 microversion: 2.1 time: 0.177185 Jul 14 17:59:02.035444 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 356/762] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:01 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1662 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:59:02.224672 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-1a22633d-e7da-462d-ab48-e4ba83fbc32b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:02.225799 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-1a22633d-e7da-462d-ab48-e4ba83fbc32b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:02.232862 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1a22633d-e7da-462d-ab48-e4ba83fbc32b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:02.233608 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1a22633d-e7da-462d-ab48-e4ba83fbc32b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:02.234962 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1a22633d-e7da-462d-ab48-e4ba83fbc32b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:02.236508 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1a22633d-e7da-462d-ab48-e4ba83fbc32b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:02.402210 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-1a22633d-e7da-462d-ab48-e4ba83fbc32b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:02.418058 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-1a22633d-e7da-462d-ab48-e4ba83fbc32b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 200 len: 1728 microversion: 2.1 time: 0.197880 Jul 14 17:59:02.419364 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 407/763] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:02 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 1728 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:59:02.446212 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-2db6c84e-f8b8-4c54-8a10-71594a61dc8c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:02.446722 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-2db6c84e-f8b8-4c54-8a10-71594a61dc8c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:02.453447 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2db6c84e-f8b8-4c54-8a10-71594a61dc8c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:02.453905 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2db6c84e-f8b8-4c54-8a10-71594a61dc8c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:02.454727 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2db6c84e-f8b8-4c54-8a10-71594a61dc8c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:02.455133 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2db6c84e-f8b8-4c54-8a10-71594a61dc8c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:02.557956 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-2db6c84e-f8b8-4c54-8a10-71594a61dc8c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.116864 Jul 14 17:59:02.558574 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 357/764] 10.222.0.64 () {58 vars in 1274 bytes} [Thu Jul 14 17:59:02 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6/os-interface => generated 284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:59:03.052050 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-c8149916-dd7a-4a8c-aa9c-17def0a833e4 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:03.052843 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-c8149916-dd7a-4a8c-aa9c-17def0a833e4 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:03.060752 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c8149916-dd7a-4a8c-aa9c-17def0a833e4 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:03.061322 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c8149916-dd7a-4a8c-aa9c-17def0a833e4 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:03.062185 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c8149916-dd7a-4a8c-aa9c-17def0a833e4 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:03.062716 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c8149916-dd7a-4a8c-aa9c-17def0a833e4 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:03.295228 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-c8149916-dd7a-4a8c-aa9c-17def0a833e4 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:03.304054 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-c8149916-dd7a-4a8c-aa9c-17def0a833e4 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1662 microversion: 2.1 time: 0.256285 Jul 14 17:59:03.304555 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 408/765] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:03 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1662 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:59:03.758176 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-3a743053-e23a-431e-936e-0f29d4de354a req-8e072154-c9cf-473a-a378-2685583ce9b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baa9b44b-200c-4ce7-8026-630090c848b6", "tag": "213c9b29-ab9e-4c3a-9f2c-712786e0d8e0"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:59:03.767812 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-3a743053-e23a-431e-936e-0f29d4de354a req-8e072154-c9cf-473a-a378-2685583ce9b9 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:03.768392 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-3a743053-e23a-431e-936e-0f29d4de354a req-8e072154-c9cf-473a-a378-2685583ce9b9 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:03.782218 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-3a743053-e23a-431e-936e-0f29d4de354a req-8e072154-c9cf-473a-a378-2685583ce9b9 service nova] Creating event network-changed:213c9b29-ab9e-4c3a-9f2c-712786e0d8e0 for instance baa9b44b-200c-4ce7-8026-630090c848b6 on hv-cinder-84989 Jul 14 17:59:03.788313 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-3a743053-e23a-431e-936e-0f29d4de354a req-8e072154-c9cf-473a-a378-2685583ce9b9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107451 Jul 14 17:59:03.789381 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 358/766] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 17:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 17:59:04.330694 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-04e7b03d-5100-4eac-a982-ff1f35e76b81 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:04.331757 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-04e7b03d-5100-4eac-a982-ff1f35e76b81 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:04.336976 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_api:SELECT=43 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:59:04.342975 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-04e7b03d-5100-4eac-a982-ff1f35e76b81 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:04.344004 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-04e7b03d-5100-4eac-a982-ff1f35e76b81 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:04.344990 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-04e7b03d-5100-4eac-a982-ff1f35e76b81 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:04.345869 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-04e7b03d-5100-4eac-a982-ff1f35e76b81 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:04.530140 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-04e7b03d-5100-4eac-a982-ff1f35e76b81 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:04.538329 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-04e7b03d-5100-4eac-a982-ff1f35e76b81 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1666 microversion: 2.1 time: 0.213162 Jul 14 17:59:04.538921 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 409/767] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:04 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1666 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:59:05.809047 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-13010809-34c3-4ded-b70a-2482ec1367be req-33d376c9-a06a-4828-aae3-9a679057127f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baa9b44b-200c-4ce7-8026-630090c848b6", "tag": "213c9b29-ab9e-4c3a-9f2c-712786e0d8e0"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:59:05.817816 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-13010809-34c3-4ded-b70a-2482ec1367be req-33d376c9-a06a-4828-aae3-9a679057127f service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:05.818349 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-13010809-34c3-4ded-b70a-2482ec1367be req-33d376c9-a06a-4828-aae3-9a679057127f service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:05.830638 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-13010809-34c3-4ded-b70a-2482ec1367be req-33d376c9-a06a-4828-aae3-9a679057127f service nova] Creating event network-changed:213c9b29-ab9e-4c3a-9f2c-712786e0d8e0 for instance baa9b44b-200c-4ce7-8026-630090c848b6 on hv-cinder-84989 Jul 14 17:59:05.835655 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-13010809-34c3-4ded-b70a-2482ec1367be req-33d376c9-a06a-4828-aae3-9a679057127f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031249 Jul 14 17:59:05.836378 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 359/768] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 17:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:59:11.785842 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-df08f616-7702-4279-9c8a-ef50091c39e0 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:59:11.786914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-df08f616-7702-4279-9c8a-ef50091c39e0 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:11.794125 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-df08f616-7702-4279-9c8a-ef50091c39e0 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:11.794577 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-df08f616-7702-4279-9c8a-ef50091c39e0 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:11.795367 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-df08f616-7702-4279-9c8a-ef50091c39e0 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:11.795810 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-df08f616-7702-4279-9c8a-ef50091c39e0 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:11.874954 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-df08f616-7702-4279-9c8a-ef50091c39e0 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "POST /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19/action" status: 202 len: 0 microversion: 2.1 time: 0.093412 Jul 14 17:59:11.875628 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 410/769] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Jul 14 17:59:11 2022] POST /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 17:59:11.889094 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-e8826202-e19a-44e9-b893-bb913fc1f53d tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:11.890340 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-e8826202-e19a-44e9-b893-bb913fc1f53d tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:11.896749 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_api:SELECT=45 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:59:11.904861 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e8826202-e19a-44e9-b893-bb913fc1f53d tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:11.905703 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e8826202-e19a-44e9-b893-bb913fc1f53d tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:11.907781 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e8826202-e19a-44e9-b893-bb913fc1f53d tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:11.908635 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e8826202-e19a-44e9-b893-bb913fc1f53d tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:12.084094 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-e8826202-e19a-44e9-b893-bb913fc1f53d tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:12.092712 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-e8826202-e19a-44e9-b893-bb913fc1f53d tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1752 microversion: 2.1 time: 0.211436 Jul 14 17:59:12.093527 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 360/770] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:11 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1752 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:59:13.113296 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-18187293-531b-4975-b1f3-d49de931597a tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:13.114010 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-18187293-531b-4975-b1f3-d49de931597a tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:13.120946 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-18187293-531b-4975-b1f3-d49de931597a tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:13.121393 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-18187293-531b-4975-b1f3-d49de931597a tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:13.122544 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-18187293-531b-4975-b1f3-d49de931597a tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:13.122678 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-18187293-531b-4975-b1f3-d49de931597a tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:13.278880 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-18187293-531b-4975-b1f3-d49de931597a tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:13.287547 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-18187293-531b-4975-b1f3-d49de931597a tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1757 microversion: 2.1 time: 0.179187 Jul 14 17:59:13.288159 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 411/771] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:13 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:59:14.306338 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-c707efdb-2117-48da-8029-c2b7348660b3 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:14.306942 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-c707efdb-2117-48da-8029-c2b7348660b3 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:14.314142 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c707efdb-2117-48da-8029-c2b7348660b3 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:14.314590 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c707efdb-2117-48da-8029-c2b7348660b3 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:14.315383 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c707efdb-2117-48da-8029-c2b7348660b3 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:14.315828 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c707efdb-2117-48da-8029-c2b7348660b3 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:14.482369 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-c707efdb-2117-48da-8029-c2b7348660b3 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:14.491505 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-c707efdb-2117-48da-8029-c2b7348660b3 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1757 microversion: 2.1 time: 0.189044 Jul 14 17:59:14.492212 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 361/772] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:14 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1757 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:59:15.508907 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-fc1360ba-6950-4f7e-89f2-f96730065d72 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:15.509513 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-fc1360ba-6950-4f7e-89f2-f96730065d72 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:15.519722 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fc1360ba-6950-4f7e-89f2-f96730065d72 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:15.520525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fc1360ba-6950-4f7e-89f2-f96730065d72 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:15.521848 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fc1360ba-6950-4f7e-89f2-f96730065d72 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:15.522562 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fc1360ba-6950-4f7e-89f2-f96730065d72 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:15.683204 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-fc1360ba-6950-4f7e-89f2-f96730065d72 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:15.691533 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-fc1360ba-6950-4f7e-89f2-f96730065d72 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1757 microversion: 2.1 time: 0.186480 Jul 14 17:59:15.692141 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 412/773] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:15 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1757 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:59:16.709673 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-a786a806-d556-4e27-95b1-0c6e6be73c5d tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:16.710350 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-a786a806-d556-4e27-95b1-0c6e6be73c5d tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:16.717237 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a786a806-d556-4e27-95b1-0c6e6be73c5d tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:16.717685 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a786a806-d556-4e27-95b1-0c6e6be73c5d tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:16.718472 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a786a806-d556-4e27-95b1-0c6e6be73c5d tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:16.718923 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a786a806-d556-4e27-95b1-0c6e6be73c5d tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:16.872294 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-a786a806-d556-4e27-95b1-0c6e6be73c5d tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:16.885629 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-a786a806-d556-4e27-95b1-0c6e6be73c5d tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1757 microversion: 2.1 time: 0.179584 Jul 14 17:59:16.886769 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 362/774] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:16 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:59:17.906457 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-95ced3eb-26de-4e2e-8333-200364b4db38 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:17.907056 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-95ced3eb-26de-4e2e-8333-200364b4db38 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:17.914626 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-95ced3eb-26de-4e2e-8333-200364b4db38 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:17.915069 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-95ced3eb-26de-4e2e-8333-200364b4db38 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:17.915859 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-95ced3eb-26de-4e2e-8333-200364b4db38 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:17.916363 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-95ced3eb-26de-4e2e-8333-200364b4db38 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:18.087989 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-95ced3eb-26de-4e2e-8333-200364b4db38 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:18.097732 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-95ced3eb-26de-4e2e-8333-200364b4db38 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1757 microversion: 2.1 time: 0.195188 Jul 14 17:59:18.098300 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 413/775] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:17 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1757 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:59:19.117829 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-85953c51-38d2-4f00-a8cd-4ecd46c41140 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:19.118702 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-85953c51-38d2-4f00-a8cd-4ecd46c41140 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:19.126678 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-85953c51-38d2-4f00-a8cd-4ecd46c41140 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:19.127745 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-85953c51-38d2-4f00-a8cd-4ecd46c41140 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:19.128476 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-85953c51-38d2-4f00-a8cd-4ecd46c41140 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:19.128901 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-85953c51-38d2-4f00-a8cd-4ecd46c41140 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:19.290518 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-85953c51-38d2-4f00-a8cd-4ecd46c41140 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:19.299154 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-85953c51-38d2-4f00-a8cd-4ecd46c41140 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1757 microversion: 2.1 time: 0.184737 Jul 14 17:59:19.299743 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 363/776] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:19 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1757 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:59:20.316979 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-4b94b1e7-06b2-49f3-b53c-dd017e6a29ff tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:20.317603 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-4b94b1e7-06b2-49f3-b53c-dd017e6a29ff tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:20.324865 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4b94b1e7-06b2-49f3-b53c-dd017e6a29ff tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:20.325355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4b94b1e7-06b2-49f3-b53c-dd017e6a29ff tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:20.326114 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4b94b1e7-06b2-49f3-b53c-dd017e6a29ff tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:20.326557 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4b94b1e7-06b2-49f3-b53c-dd017e6a29ff tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:20.523359 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-4b94b1e7-06b2-49f3-b53c-dd017e6a29ff tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:20.532027 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-4b94b1e7-06b2-49f3-b53c-dd017e6a29ff tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1757 microversion: 2.1 time: 0.219381 Jul 14 17:59:20.532612 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 414/777] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:20 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1757 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:59:21.553805 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-e4818ce9-da8e-4997-8c99-1cb16efe10a1 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:21.554618 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-e4818ce9-da8e-4997-8c99-1cb16efe10a1 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:21.561335 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e4818ce9-da8e-4997-8c99-1cb16efe10a1 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:21.561784 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e4818ce9-da8e-4997-8c99-1cb16efe10a1 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:21.562562 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e4818ce9-da8e-4997-8c99-1cb16efe10a1 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:21.562999 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e4818ce9-da8e-4997-8c99-1cb16efe10a1 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:21.727151 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-e4818ce9-da8e-4997-8c99-1cb16efe10a1 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:21.735171 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-e4818ce9-da8e-4997-8c99-1cb16efe10a1 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1757 microversion: 2.1 time: 0.185422 Jul 14 17:59:21.735751 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 364/778] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:21 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1757 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:59:22.752914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-613ac2b4-635e-4135-834c-0ec6a7d3617a tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:22.753519 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-613ac2b4-635e-4135-834c-0ec6a7d3617a tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:22.760193 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-613ac2b4-635e-4135-834c-0ec6a7d3617a tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:22.760645 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-613ac2b4-635e-4135-834c-0ec6a7d3617a tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:22.761423 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-613ac2b4-635e-4135-834c-0ec6a7d3617a tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:22.761852 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-613ac2b4-635e-4135-834c-0ec6a7d3617a tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:22.908739 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-613ac2b4-635e-4135-834c-0ec6a7d3617a tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:22.917260 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-613ac2b4-635e-4135-834c-0ec6a7d3617a tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1757 microversion: 2.1 time: 0.168271 Jul 14 17:59:22.917824 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 415/779] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:22 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:59:23.938142 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-c019b9a6-1cda-414e-b6d0-c9f669cdad82 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:23.939569 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-c019b9a6-1cda-414e-b6d0-c9f669cdad82 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:23.949033 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c019b9a6-1cda-414e-b6d0-c9f669cdad82 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:23.949491 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c019b9a6-1cda-414e-b6d0-c9f669cdad82 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:23.950292 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c019b9a6-1cda-414e-b6d0-c9f669cdad82 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:23.950746 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c019b9a6-1cda-414e-b6d0-c9f669cdad82 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:24.101150 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-c019b9a6-1cda-414e-b6d0-c9f669cdad82 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:24.109295 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-c019b9a6-1cda-414e-b6d0-c9f669cdad82 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1757 microversion: 2.1 time: 0.178143 Jul 14 17:59:24.109865 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 365/780] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:23 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:59:25.131826 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-0fc9af76-a7b5-4346-9af3-15ef26c018d5 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:25.132981 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-0fc9af76-a7b5-4346-9af3-15ef26c018d5 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:25.143787 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0fc9af76-a7b5-4346-9af3-15ef26c018d5 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:25.144893 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0fc9af76-a7b5-4346-9af3-15ef26c018d5 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:25.146353 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0fc9af76-a7b5-4346-9af3-15ef26c018d5 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:25.147077 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0fc9af76-a7b5-4346-9af3-15ef26c018d5 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:25.304539 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-0fc9af76-a7b5-4346-9af3-15ef26c018d5 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:25.312633 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-0fc9af76-a7b5-4346-9af3-15ef26c018d5 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1757 microversion: 2.1 time: 0.188462 Jul 14 17:59:25.313201 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 416/781] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:25 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1757 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:59:26.329853 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-12e7a969-6450-4360-8ce2-a1bd794c2173 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:26.330451 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-12e7a969-6450-4360-8ce2-a1bd794c2173 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:26.338030 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-12e7a969-6450-4360-8ce2-a1bd794c2173 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:26.338526 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-12e7a969-6450-4360-8ce2-a1bd794c2173 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:26.339423 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-12e7a969-6450-4360-8ce2-a1bd794c2173 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:26.339899 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-12e7a969-6450-4360-8ce2-a1bd794c2173 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:26.496887 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-12e7a969-6450-4360-8ce2-a1bd794c2173 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:26.510227 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-12e7a969-6450-4360-8ce2-a1bd794c2173 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1757 microversion: 2.1 time: 0.183844 Jul 14 17:59:26.511181 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 366/782] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:26 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1757 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:59:27.529364 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-32d9c2d9-623d-440d-adad-b2fa8e8bd9db tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:27.530050 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-32d9c2d9-623d-440d-adad-b2fa8e8bd9db tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:27.537938 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-32d9c2d9-623d-440d-adad-b2fa8e8bd9db tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:27.538390 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-32d9c2d9-623d-440d-adad-b2fa8e8bd9db tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:27.539197 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-32d9c2d9-623d-440d-adad-b2fa8e8bd9db tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:27.539641 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-32d9c2d9-623d-440d-adad-b2fa8e8bd9db tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:27.693856 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-32d9c2d9-623d-440d-adad-b2fa8e8bd9db tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:27.700100 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:59:27.709758 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-32d9c2d9-623d-440d-adad-b2fa8e8bd9db tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1757 microversion: 2.1 time: 0.184124 Jul 14 17:59:27.710694 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 417/783] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:27 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1757 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:59:28.737759 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-75c6f234-626a-47bc-92cd-b6fe86ea0985 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:28.738419 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-75c6f234-626a-47bc-92cd-b6fe86ea0985 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:28.745268 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-75c6f234-626a-47bc-92cd-b6fe86ea0985 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:28.745717 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-75c6f234-626a-47bc-92cd-b6fe86ea0985 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:28.746493 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-75c6f234-626a-47bc-92cd-b6fe86ea0985 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:28.746928 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-75c6f234-626a-47bc-92cd-b6fe86ea0985 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:28.749757 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:59:28.912945 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-75c6f234-626a-47bc-92cd-b6fe86ea0985 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:28.923340 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-75c6f234-626a-47bc-92cd-b6fe86ea0985 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1757 microversion: 2.1 time: 0.190527 Jul 14 17:59:28.923897 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 367/784] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:28 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1757 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:59:29.941935 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-e02c8159-0474-4e55-ace2-c4bbbb06c822 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:29.942585 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-e02c8159-0474-4e55-ace2-c4bbbb06c822 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:29.950397 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e02c8159-0474-4e55-ace2-c4bbbb06c822 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:29.950956 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e02c8159-0474-4e55-ace2-c4bbbb06c822 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:29.951635 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e02c8159-0474-4e55-ace2-c4bbbb06c822 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:29.952233 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e02c8159-0474-4e55-ace2-c4bbbb06c822 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:30.110365 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-e02c8159-0474-4e55-ace2-c4bbbb06c822 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:30.118416 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-e02c8159-0474-4e55-ace2-c4bbbb06c822 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1760 microversion: 2.1 time: 0.181203 Jul 14 17:59:30.118984 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 418/785] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:29 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1760 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:59:31.701693 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-17d4ae9d-cdfb-402f-8e49-514f6aa34790 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:31.702232 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-17d4ae9d-cdfb-402f-8e49-514f6aa34790 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:31.709239 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-17d4ae9d-cdfb-402f-8e49-514f6aa34790 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:31.709692 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-17d4ae9d-cdfb-402f-8e49-514f6aa34790 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:31.710467 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-17d4ae9d-cdfb-402f-8e49-514f6aa34790 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:31.710910 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-17d4ae9d-cdfb-402f-8e49-514f6aa34790 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:31.739547 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-17d4ae9d-cdfb-402f-8e49-514f6aa34790 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17/os-volume_attachments/4b0f0508-904a-48ea-986c-c6a71fc6ebe7" status: 200 len: 194 microversion: 2.20 time: 0.041851 Jul 14 17:59:31.740165 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 368/786] 10.222.0.64 () {60 vars in 1453 bytes} [Thu Jul 14 17:59:31 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17/os-volume_attachments/4b0f0508-904a-48ea-986c-c6a71fc6ebe7 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 17:59:31.803121 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-55e4204f-ab4c-4557-883e-b25a5b6b519b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:31.803641 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-55e4204f-ab4c-4557-883e-b25a5b6b519b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:31.811546 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-55e4204f-ab4c-4557-883e-b25a5b6b519b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:31.812029 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-55e4204f-ab4c-4557-883e-b25a5b6b519b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:31.812804 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-55e4204f-ab4c-4557-883e-b25a5b6b519b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:31.813245 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-55e4204f-ab4c-4557-883e-b25a5b6b519b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:31.897094 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.objects.instance [None req-55e4204f-ab4c-4557-883e-b25a5b6b519b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lazy-loading 'services' on Instance uuid afa45fb8-7566-483d-95ce-8f0242138b17 {{(pid=129471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 17:59:32.009038 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-55e4204f-ab4c-4557-883e-b25a5b6b519b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "DELETE /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17/os-volume_attachments/4b0f0508-904a-48ea-986c-c6a71fc6ebe7" status: 202 len: 0 microversion: 2.20 time: 0.209834 Jul 14 17:59:32.009683 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 419/787] 10.222.0.64 () {60 vars in 1456 bytes} [Thu Jul 14 17:59:31 2022] DELETE /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17/os-volume_attachments/4b0f0508-904a-48ea-986c-c6a71fc6ebe7 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 17:59:32.018160 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-f50c1270-7935-486d-a26e-47fedf7b4ef0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:32.019088 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-f50c1270-7935-486d-a26e-47fedf7b4ef0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:32.026121 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f50c1270-7935-486d-a26e-47fedf7b4ef0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:32.026616 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f50c1270-7935-486d-a26e-47fedf7b4ef0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:32.027593 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f50c1270-7935-486d-a26e-47fedf7b4ef0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:32.028073 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f50c1270-7935-486d-a26e-47fedf7b4ef0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:32.059783 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-f50c1270-7935-486d-a26e-47fedf7b4ef0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045644 Jul 14 17:59:32.060413 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 369/788] 10.222.0.64 () {60 vars in 1342 bytes} [Thu Jul 14 17:59:32 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 17:59:32.260533 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-3927f1ef-2c71-450f-9318-2946b51a3908 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:59:32.261330 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-3927f1ef-2c71-450f-9318-2946b51a3908 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:32.268546 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3927f1ef-2c71-450f-9318-2946b51a3908 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:32.269227 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3927f1ef-2c71-450f-9318-2946b51a3908 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:32.270210 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3927f1ef-2c71-450f-9318-2946b51a3908 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:32.270649 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3927f1ef-2c71-450f-9318-2946b51a3908 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:32.294037 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.objects.instance [None req-3927f1ef-2c71-450f-9318-2946b51a3908 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lazy-loading 'flavor' on Instance uuid 28947673-5bde-4923-9e70-bec5086fe9c6 {{(pid=129471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 17:59:32.369213 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-3927f1ef-2c71-450f-9318-2946b51a3908 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "POST /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6/action" status: 202 len: 0 microversion: 2.1 time: 0.112906 Jul 14 17:59:32.369937 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 420/789] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Jul 14 17:59:32 2022] POST /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 17:59:32.378143 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-acc6503f-71ba-4099-9e31-b94dd149ac45 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:32.378757 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-acc6503f-71ba-4099-9e31-b94dd149ac45 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:32.385508 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-acc6503f-71ba-4099-9e31-b94dd149ac45 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:32.385960 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-acc6503f-71ba-4099-9e31-b94dd149ac45 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:32.386727 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-acc6503f-71ba-4099-9e31-b94dd149ac45 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:32.387164 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-acc6503f-71ba-4099-9e31-b94dd149ac45 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:32.519890 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-acc6503f-71ba-4099-9e31-b94dd149ac45 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:32.527599 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-acc6503f-71ba-4099-9e31-b94dd149ac45 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1569 microversion: 2.1 time: 0.153235 Jul 14 17:59:32.528207 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 370/790] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:32 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:59:33.071385 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-c391c4a9-5645-4342-a9f1-6d3d84ba1273 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:33.072529 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-c391c4a9-5645-4342-a9f1-6d3d84ba1273 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:33.079459 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c391c4a9-5645-4342-a9f1-6d3d84ba1273 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:33.080006 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c391c4a9-5645-4342-a9f1-6d3d84ba1273 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:33.080723 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c391c4a9-5645-4342-a9f1-6d3d84ba1273 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:33.081164 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c391c4a9-5645-4342-a9f1-6d3d84ba1273 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:33.112899 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-c391c4a9-5645-4342-a9f1-6d3d84ba1273 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045826 Jul 14 17:59:33.113483 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 421/791] 10.222.0.64 () {60 vars in 1342 bytes} [Thu Jul 14 17:59:33 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 17:59:33.545264 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-33f428b7-9f4d-4c14-b380-52f7556ecdfe tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:33.545932 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-33f428b7-9f4d-4c14-b380-52f7556ecdfe tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:33.552613 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-33f428b7-9f4d-4c14-b380-52f7556ecdfe tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:33.553062 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-33f428b7-9f4d-4c14-b380-52f7556ecdfe tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:33.553848 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-33f428b7-9f4d-4c14-b380-52f7556ecdfe tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:33.554288 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-33f428b7-9f4d-4c14-b380-52f7556ecdfe tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:33.683705 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-33f428b7-9f4d-4c14-b380-52f7556ecdfe tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:33.691259 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-33f428b7-9f4d-4c14-b380-52f7556ecdfe tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1569 microversion: 2.1 time: 0.149900 Jul 14 17:59:33.692480 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 371/792] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:33 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:59:34.124958 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-185043a9-5fda-4b75-b56e-a843b799a5eb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:34.126040 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-185043a9-5fda-4b75-b56e-a843b799a5eb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:34.133207 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-185043a9-5fda-4b75-b56e-a843b799a5eb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:34.133450 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-185043a9-5fda-4b75-b56e-a843b799a5eb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:34.134165 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-185043a9-5fda-4b75-b56e-a843b799a5eb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:34.134583 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-185043a9-5fda-4b75-b56e-a843b799a5eb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:34.165436 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-185043a9-5fda-4b75-b56e-a843b799a5eb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044445 Jul 14 17:59:34.166047 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 422/793] 10.222.0.64 () {60 vars in 1342 bytes} [Thu Jul 14 17:59:34 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:59:34.226848 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-23318f49-bb94-48cf-8e98-71a256e095c3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:34.227344 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-23318f49-bb94-48cf-8e98-71a256e095c3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:34.234142 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-23318f49-bb94-48cf-8e98-71a256e095c3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:34.234604 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-23318f49-bb94-48cf-8e98-71a256e095c3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:34.235392 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-23318f49-bb94-48cf-8e98-71a256e095c3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:34.235832 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-23318f49-bb94-48cf-8e98-71a256e095c3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:34.261040 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-23318f49-bb94-48cf-8e98-71a256e095c3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Going to try to terminate instance {{(pid=129470) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 17:59:34.338806 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-23318f49-bb94-48cf-8e98-71a256e095c3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "DELETE /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 204 len: 0 microversion: 2.20 time: 0.115812 Jul 14 17:59:34.339467 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 372/794] 10.222.0.64 () {60 vars in 1279 bytes} [Thu Jul 14 17:59:34 2022] DELETE /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 17:59:34.348601 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-173ee47d-52b7-4493-917c-8a89b46ca425 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:34.349222 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-173ee47d-52b7-4493-917c-8a89b46ca425 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:34.352193 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_api:SELECT=29 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:59:34.356213 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-173ee47d-52b7-4493-917c-8a89b46ca425 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:34.356656 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-173ee47d-52b7-4493-917c-8a89b46ca425 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:34.357412 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-173ee47d-52b7-4493-917c-8a89b46ca425 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:34.357843 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-173ee47d-52b7-4493-917c-8a89b46ca425 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:34.488385 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-173ee47d-52b7-4493-917c-8a89b46ca425 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:34.497245 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-173ee47d-52b7-4493-917c-8a89b46ca425 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:34.499106 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-173ee47d-52b7-4493-917c-8a89b46ca425 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:34.500658 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-173ee47d-52b7-4493-917c-8a89b46ca425 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1725 microversion: 2.20 time: 0.156755 Jul 14 17:59:34.501628 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 423/795] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:59:34 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:59:34.710024 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-04d5436b-800f-4ae5-b8c9-c8a1aa62ccc8 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:34.710765 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-04d5436b-800f-4ae5-b8c9-c8a1aa62ccc8 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:34.717357 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-04d5436b-800f-4ae5-b8c9-c8a1aa62ccc8 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:34.717812 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-04d5436b-800f-4ae5-b8c9-c8a1aa62ccc8 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:34.718619 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-04d5436b-800f-4ae5-b8c9-c8a1aa62ccc8 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:34.719060 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-04d5436b-800f-4ae5-b8c9-c8a1aa62ccc8 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:34.871232 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-04d5436b-800f-4ae5-b8c9-c8a1aa62ccc8 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:34.879577 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-04d5436b-800f-4ae5-b8c9-c8a1aa62ccc8 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1569 microversion: 2.1 time: 0.173775 Jul 14 17:59:34.880198 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 373/796] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:34 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:59:35.519260 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-566860cf-5a38-48da-80c0-5424e6a02143 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:35.519957 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-566860cf-5a38-48da-80c0-5424e6a02143 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:35.526403 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-566860cf-5a38-48da-80c0-5424e6a02143 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:35.526846 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-566860cf-5a38-48da-80c0-5424e6a02143 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:35.527688 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-566860cf-5a38-48da-80c0-5424e6a02143 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:35.528155 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-566860cf-5a38-48da-80c0-5424e6a02143 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:35.668218 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-566860cf-5a38-48da-80c0-5424e6a02143 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:35.677270 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-566860cf-5a38-48da-80c0-5424e6a02143 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:35.678783 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-566860cf-5a38-48da-80c0-5424e6a02143 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:35.679990 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-566860cf-5a38-48da-80c0-5424e6a02143 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1725 microversion: 2.20 time: 0.164779 Jul 14 17:59:35.680550 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 424/797] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:59:35 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:59:35.898424 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-bdcb0f56-3080-43f5-8861-7bdaec9f6332 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:35.899264 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-bdcb0f56-3080-43f5-8861-7bdaec9f6332 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:35.907004 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-bdcb0f56-3080-43f5-8861-7bdaec9f6332 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:35.907459 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-bdcb0f56-3080-43f5-8861-7bdaec9f6332 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:35.908279 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-bdcb0f56-3080-43f5-8861-7bdaec9f6332 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:35.908727 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-bdcb0f56-3080-43f5-8861-7bdaec9f6332 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:36.042650 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-bdcb0f56-3080-43f5-8861-7bdaec9f6332 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:36.050360 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-bdcb0f56-3080-43f5-8861-7bdaec9f6332 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1569 microversion: 2.1 time: 0.157236 Jul 14 17:59:36.050936 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 374/798] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:35 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:59:36.699325 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-54baac4d-ecf4-40bf-b2f5-4875526d4470 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:36.699940 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-54baac4d-ecf4-40bf-b2f5-4875526d4470 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:36.707401 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-54baac4d-ecf4-40bf-b2f5-4875526d4470 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:36.707850 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-54baac4d-ecf4-40bf-b2f5-4875526d4470 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:36.708691 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-54baac4d-ecf4-40bf-b2f5-4875526d4470 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:36.709146 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-54baac4d-ecf4-40bf-b2f5-4875526d4470 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:36.840137 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-54baac4d-ecf4-40bf-b2f5-4875526d4470 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:36.848556 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-54baac4d-ecf4-40bf-b2f5-4875526d4470 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:36.850094 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-54baac4d-ecf4-40bf-b2f5-4875526d4470 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:36.851218 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-54baac4d-ecf4-40bf-b2f5-4875526d4470 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1725 microversion: 2.20 time: 0.156453 Jul 14 17:59:36.851995 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 425/799] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:59:36 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:59:37.067031 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-a3eef2e7-01ed-4a80-8f8b-25c2353d1049 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:37.067667 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-a3eef2e7-01ed-4a80-8f8b-25c2353d1049 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:37.074254 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a3eef2e7-01ed-4a80-8f8b-25c2353d1049 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:37.074711 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a3eef2e7-01ed-4a80-8f8b-25c2353d1049 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:37.075497 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a3eef2e7-01ed-4a80-8f8b-25c2353d1049 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:37.075959 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a3eef2e7-01ed-4a80-8f8b-25c2353d1049 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:37.212228 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-a3eef2e7-01ed-4a80-8f8b-25c2353d1049 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:37.219952 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-a3eef2e7-01ed-4a80-8f8b-25c2353d1049 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1569 microversion: 2.1 time: 0.157003 Jul 14 17:59:37.220535 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 375/800] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:37 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:59:37.798469 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [req-86d57f6b-ba9f-4848-a0a5-a615b1b7076c req-1acda54a-ed82-48be-be1c-656990e27a51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afa45fb8-7566-483d-95ce-8f0242138b17", "name": "network-vif-deleted", "tag": "babcf3c4-dfb9-4f4a-a0d8-6a98c8a91d00"}]} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:59:37.809141 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-86d57f6b-ba9f-4848-a0a5-a615b1b7076c req-1acda54a-ed82-48be-be1c-656990e27a51 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:37.810014 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-86d57f6b-ba9f-4848-a0a5-a615b1b7076c req-1acda54a-ed82-48be-be1c-656990e27a51 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:37.827640 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.compute.server_external_events [req-86d57f6b-ba9f-4848-a0a5-a615b1b7076c req-1acda54a-ed82-48be-be1c-656990e27a51 service nova] Creating event network-vif-deleted:babcf3c4-dfb9-4f4a-a0d8-6a98c8a91d00 for instance afa45fb8-7566-483d-95ce-8f0242138b17 on hv-cinder-84989 Jul 14 17:59:37.833324 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [req-86d57f6b-ba9f-4848-a0a5-a615b1b7076c req-1acda54a-ed82-48be-be1c-656990e27a51 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103598 Jul 14 17:59:37.836105 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 426/801] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 17:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 17:59:37.871013 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-19a17835-5599-46f5-90a2-a45de3875ac2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:37.871540 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-19a17835-5599-46f5-90a2-a45de3875ac2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:37.879324 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-19a17835-5599-46f5-90a2-a45de3875ac2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:37.879779 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-19a17835-5599-46f5-90a2-a45de3875ac2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:37.880686 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-19a17835-5599-46f5-90a2-a45de3875ac2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:37.881131 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-19a17835-5599-46f5-90a2-a45de3875ac2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:37.922733 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-19a17835-5599-46f5-90a2-a45de3875ac2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:37.923199 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-19a17835-5599-46f5-90a2-a45de3875ac2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:37.923804 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.objects.instance [None req-19a17835-5599-46f5-90a2-a45de3875ac2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lazy-loading 'fault' on Instance uuid afa45fb8-7566-483d-95ce-8f0242138b17 {{(pid=129470) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 17:59:37.970145 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-19a17835-5599-46f5-90a2-a45de3875ac2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:37.978567 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-19a17835-5599-46f5-90a2-a45de3875ac2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:37.980084 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-19a17835-5599-46f5-90a2-a45de3875ac2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:37.981238 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-19a17835-5599-46f5-90a2-a45de3875ac2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 200 len: 1371 microversion: 2.20 time: 0.115860 Jul 14 17:59:37.981944 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 376/802] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:59:37 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 1371 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:59:38.238561 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-7687addd-00bd-417d-a4e5-5059cd3130dc tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:38.239565 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-7687addd-00bd-417d-a4e5-5059cd3130dc tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:38.246779 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7687addd-00bd-417d-a4e5-5059cd3130dc tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:38.247475 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7687addd-00bd-417d-a4e5-5059cd3130dc tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:38.248514 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7687addd-00bd-417d-a4e5-5059cd3130dc tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:38.248888 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7687addd-00bd-417d-a4e5-5059cd3130dc tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:38.406162 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-7687addd-00bd-417d-a4e5-5059cd3130dc tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:38.417569 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-7687addd-00bd-417d-a4e5-5059cd3130dc tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1569 microversion: 2.1 time: 0.181967 Jul 14 17:59:38.418812 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 427/803] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:38 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1569 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:59:38.999079 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-e7bdc029-9dd4-4395-a9ed-2a4b47f3db22 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:38.999615 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-e7bdc029-9dd4-4395-a9ed-2a4b47f3db22 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:39.006602 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e7bdc029-9dd4-4395-a9ed-2a4b47f3db22 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:39.007048 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e7bdc029-9dd4-4395-a9ed-2a4b47f3db22 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:39.007852 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e7bdc029-9dd4-4395-a9ed-2a4b47f3db22 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:39.008314 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e7bdc029-9dd4-4395-a9ed-2a4b47f3db22 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:39.022443 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.wsgi [None req-e7bdc029-9dd4-4395-a9ed-2a4b47f3db22 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] HTTP exception thrown: Instance afa45fb8-7566-483d-95ce-8f0242138b17 could not be found. Jul 14 17:59:39.024640 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-e7bdc029-9dd4-4395-a9ed-2a4b47f3db22 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Request method failure captured: Jul 14 17:59:39.024640 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: request: GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 HTTP/1.1 Jul 14 17:59:39.024640 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept: application/json Jul 14 17:59:39.024640 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept-Encoding: identity Jul 14 17:59:39.024640 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Connection: close Jul 14 17:59:39.024640 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Length: 0 Jul 14 17:59:39.024640 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Type: application/json Jul 14 17:59:39.024640 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Host: 10.222.0.64 Jul 14 17:59:39.024640 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Openstack-System-Scope: None Jul 14 17:59:39.024640 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: User-Agent: python-urllib3/1.26.9 Jul 14 17:59:39.024640 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Auth-Token: gAAAAABi0FfE5MuSI_VYn8C55vxjdjViweviO2tTL2hr1UT0KTMrHB8Mlsukvh_CoxX5RDoRa5rIIBSZfoPfBiCoI12cxvQ70gEoYzW3NUlxZdV7qaNavnh9M81ALJl1S3bTr2XAX4jL71VgamrBc8b-3Nz54CftGZ84y-R1u8obuTKiBocbg-Q Jul 14 17:59:39.024640 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Id: None Jul 14 17:59:39.024640 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Name: None Jul 14 17:59:39.024640 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Identity-Status: Confirmed Jul 14 17:59:39.024640 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Is-Admin-Project: True Jul 14 17:59:39.024640 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 17:59:39.024640 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Id: default Jul 14 17:59:39.024640 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Name: Default Jul 14 17:59:39.024640 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Id: 69d2b6a5a4534cadb34e626ce33238df Jul 14 17:59:39.024640 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-91231765 Jul 14 17:59:39.024640 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Role: reader,member Jul 14 17:59:39.024640 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Roles: reader,member Jul 14 17:59:39.026445 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/69d2b6a5a4534cadb34e626ce33238df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/69d2b6a5a4534cadb34e626ce33238df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/69d2b6a5a4534cadb34e626ce33238df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_69d2b6a5a4534cadb34e626ce33238df", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 17:59:39.026445 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant: tempest-AttachVolumeShelveTestJSON-91231765 Jul 14 17:59:39.026445 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Id: 69d2b6a5a4534cadb34e626ce33238df Jul 14 17:59:39.026445 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-91231765 Jul 14 17:59:39.026445 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User: tempest-AttachVolumeShelveTestJSON-91231765-project Jul 14 17:59:39.026445 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Id: default Jul 14 17:59:39.026445 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Name: Default Jul 14 17:59:39.026445 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Id: c4178d34dc114f46af725c9dc362d224 Jul 14 17:59:39.026445 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Name: tempest-AttachVolumeShelveTestJSON-91231765-project Jul 14 17:59:39.026445 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: method: > Jul 14 17:59:39.026445 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: exception: Instance afa45fb8-7566-483d-95ce-8f0242138b17 could not be found. Jul 14 17:59:39.026445 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: action_args: {'id': 'afa45fb8-7566-483d-95ce-8f0242138b17'} Jul 14 17:59:39.027350 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 17:59:39.027350 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:59:39.027350 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 17:59:39.027350 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 17:59:39.027350 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 17:59:39.027350 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 17:59:39.027350 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 17:59:39.027350 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 17:59:39.027350 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 17:59:39.027350 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 17:59:39.027350 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afa45fb8-7566-483d-95ce-8f0242138b17 could not be found. Jul 14 17:59:39.027350 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 17:59:39.027350 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:59:39.027350 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 17:59:39.027350 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:59:39.027350 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:59:39.027350 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:59:39.027350 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 17:59:39.027350 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 17:59:39.027350 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 17:59:39.028883 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 17:59:39.028883 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 17:59:39.028883 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 17:59:39.028883 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 17:59:39.028883 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 17:59:39.028883 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 17:59:39.028883 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 17:59:39.028883 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afa45fb8-7566-483d-95ce-8f0242138b17 could not be found. Jul 14 17:59:39.028883 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 17:59:39.028883 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 17:59:39.028883 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 17:59:39.028883 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 17:59:39.028883 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 17:59:39.028883 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 17:59:39.028883 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 17:59:39.028883 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 17:59:39.028883 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afa45fb8-7566-483d-95ce-8f0242138b17 could not be found. Jul 14 17:59:39.028883 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 17:59:39.030375 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-e7bdc029-9dd4-4395-a9ed-2a4b47f3db22 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Returning 404 to user: Instance afa45fb8-7566-483d-95ce-8f0242138b17 could not be found. {{(pid=129470) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 17:59:39.030375 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-e7bdc029-9dd4-4395-a9ed-2a4b47f3db22 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 404 len: 111 microversion: 2.20 time: 0.031130 Jul 14 17:59:39.030375 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 377/804] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:59:38 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 17:59:39.035501 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-248f107b-c545-4ad4-a19a-22222b5c3c63 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '.version_select at 0x7f137b5fb8b0>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:39.060262 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-248f107b-c545-4ad4-a19a-22222b5c3c63 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-319288908" status: 204 len: 0 microversion: 2.20 time: 0.028592 Jul 14 17:59:39.060830 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 428/805] 10.222.0.64 () {60 vars in 1258 bytes} [Thu Jul 14 17:59:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-319288908 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 17:59:39.434738 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-17504b43-711d-4d8c-8168-1cb96e37b26b tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:39.435618 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-17504b43-711d-4d8c-8168-1cb96e37b26b tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:39.442104 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-17504b43-711d-4d8c-8168-1cb96e37b26b tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:39.442661 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-17504b43-711d-4d8c-8168-1cb96e37b26b tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:39.443546 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-17504b43-711d-4d8c-8168-1cb96e37b26b tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:39.444131 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-17504b43-711d-4d8c-8168-1cb96e37b26b tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:39.588581 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-17504b43-711d-4d8c-8168-1cb96e37b26b tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:39.600558 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-17504b43-711d-4d8c-8168-1cb96e37b26b tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1569 microversion: 2.1 time: 0.169629 Jul 14 17:59:39.601545 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 378/806] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:39 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:59:39.744682 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-9593c7cb-2ecf-43ab-ba06-344db80f4ca2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Action: 'create', calling method: .version_select at 0x7f137b67d040>, body: {"keypair": {"name": "tempest-keypair-1405162792", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPg1cgZT7H9b05WBsgpB9JfaX3mXOHiWEmoRP5+RAq4pl9r4k1eyf1Vr/rcjqxi92gwkUk2XPrXUXZ5CWUsW0OjHD7pXy0u2z3BbbVKqChO0Z0HBQtH7+EV0XkXgRnKCg=="}} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:59:39.761322 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.quota [None req-9593c7cb-2ecf-43ab-ba06-344db80f4ca2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Getting quotas for project 69d2b6a5a4534cadb34e626ce33238df. Resources: {'key_pairs'} {{(pid=129471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 17:59:39.765669 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.quota [None req-9593c7cb-2ecf-43ab-ba06-344db80f4ca2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Getting quotas for user c4178d34dc114f46af725c9dc362d224 and project 69d2b6a5a4534cadb34e626ce33238df. Resources: {'key_pairs'} {{(pid=129471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 17:59:39.787665 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-9593c7cb-2ecf-43ab-ba06-344db80f4ca2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.047505 Jul 14 17:59:39.788414 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 429/807] 10.222.0.64 () {62 vars in 1199 bytes} [Thu Jul 14 17:59:39 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 14 17:59:40.618625 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-2ad05918-3703-4827-a6ed-29bebe14f94c tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:40.619280 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-2ad05918-3703-4827-a6ed-29bebe14f94c tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:40.625808 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2ad05918-3703-4827-a6ed-29bebe14f94c tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:40.626257 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2ad05918-3703-4827-a6ed-29bebe14f94c tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:40.627039 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2ad05918-3703-4827-a6ed-29bebe14f94c tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:40.627475 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2ad05918-3703-4827-a6ed-29bebe14f94c tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:40.774480 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-2ad05918-3703-4827-a6ed-29bebe14f94c tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:40.782193 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-2ad05918-3703-4827-a6ed-29bebe14f94c tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1569 microversion: 2.1 time: 0.167462 Jul 14 17:59:40.782781 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 379/808] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:40 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:59:41.145224 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-520b0ed9-c10a-407f-b02c-598da37f02df tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1445067171", "imageRef": "cf1f5d8c-9e49-4272-8e19-8e3c587056e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7ce47168-d219-4fd4-9c00-8868df258117"}], "security_groups": [{"name": "tempest-securitygroup--1563789515"}], "key_name": "tempest-keypair-1405162792", "user_data": "}} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:59:41.251993 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.network.neutron [None req-520b0ed9-c10a-407f-b02c-598da37f02df tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] validate_networks() for [('7ce47168-d219-4fd4-9c00-8868df258117', None, None, None, None, None)] {{(pid=129471) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 17:59:41.798785 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-d7b5af29-eb9f-4b53-9fd0-ed06a824d95a tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:41.799419 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-d7b5af29-eb9f-4b53-9fd0-ed06a824d95a tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:41.806175 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d7b5af29-eb9f-4b53-9fd0-ed06a824d95a tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:41.806631 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d7b5af29-eb9f-4b53-9fd0-ed06a824d95a tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:41.807447 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d7b5af29-eb9f-4b53-9fd0-ed06a824d95a tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:41.807889 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d7b5af29-eb9f-4b53-9fd0-ed06a824d95a tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:42.027613 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-520b0ed9-c10a-407f-b02c-598da37f02df tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Flavor limits 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 17:59:42.028075 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-520b0ed9-c10a-407f-b02c-598da37f02df tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Image limits 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 17:59:42.028585 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-520b0ed9-c10a-407f-b02c-598da37f02df tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Flavor pref 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 17:59:42.028993 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-520b0ed9-c10a-407f-b02c-598da37f02df tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Image pref 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 17:59:42.029492 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-520b0ed9-c10a-407f-b02c-598da37f02df tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 17:59:42.032108 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-d7b5af29-eb9f-4b53-9fd0-ed06a824d95a tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:42.038625 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-520b0ed9-c10a-407f-b02c-598da37f02df tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:42.039642 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-520b0ed9-c10a-407f-b02c-598da37f02df tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:42.040311 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-d7b5af29-eb9f-4b53-9fd0-ed06a824d95a tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1569 microversion: 2.1 time: 0.245430 Jul 14 17:59:42.040484 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-520b0ed9-c10a-407f-b02c-598da37f02df tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:42.040893 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 380/809] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:41 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1569 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:59:42.041001 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-520b0ed9-c10a-407f-b02c-598da37f02df tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:42.058036 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.quota [None req-520b0ed9-c10a-407f-b02c-598da37f02df tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Getting quotas for project 69d2b6a5a4534cadb34e626ce33238df. Resources: {'ram', 'cores', 'instances'} {{(pid=129471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 17:59:42.061977 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.quota [None req-520b0ed9-c10a-407f-b02c-598da37f02df tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Getting quotas for user c4178d34dc114f46af725c9dc362d224 and project 69d2b6a5a4534cadb34e626ce33238df. Resources: {'ram', 'cores', 'instances'} {{(pid=129471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 17:59:42.072791 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-520b0ed9-c10a-407f-b02c-598da37f02df tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Going to run 1 instances... {{(pid=129471) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 17:59:42.075063 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-520b0ed9-c10a-407f-b02c-598da37f02df tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf1f5d8c-9e49-4272-8e19-8e3c587056e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 17:59:42.133652 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-520b0ed9-c10a-407f-b02c-598da37f02df tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.993231 Jul 14 17:59:42.134318 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 430/810] 10.222.0.64 () {62 vars in 1187 bytes} [Thu Jul 14 17:59:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 995 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 17:59:42.145030 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-796e1fd3-de91-455d-a876-6e895f8f8aed tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:42.145739 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-796e1fd3-de91-455d-a876-6e895f8f8aed tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:42.149080 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:59:42.212714 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-796e1fd3-de91-455d-a876-6e895f8f8aed tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:42.224625 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-796e1fd3-de91-455d-a876-6e895f8f8aed tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:42.227747 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-796e1fd3-de91-455d-a876-6e895f8f8aed tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:42.230014 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-796e1fd3-de91-455d-a876-6e895f8f8aed tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1282 microversion: 2.20 time: 0.089121 Jul 14 17:59:42.231233 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 381/811] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:59:42 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1282 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:59:43.059941 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-a5e6be37-6c3d-494a-a745-d837e43112f3 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:43.060557 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-a5e6be37-6c3d-494a-a745-d837e43112f3 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:43.067208 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a5e6be37-6c3d-494a-a745-d837e43112f3 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:43.067668 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a5e6be37-6c3d-494a-a745-d837e43112f3 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:43.068494 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a5e6be37-6c3d-494a-a745-d837e43112f3 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:43.068940 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a5e6be37-6c3d-494a-a745-d837e43112f3 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:43.228641 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-a5e6be37-6c3d-494a-a745-d837e43112f3 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:43.236713 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-a5e6be37-6c3d-494a-a745-d837e43112f3 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1569 microversion: 2.1 time: 0.181833 Jul 14 17:59:43.237319 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 431/812] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:43 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:59:43.254585 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-ab2c76c6-fd1d-4f22-ba2c-26bdbf06d1a1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:43.255617 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-ab2c76c6-fd1d-4f22-ba2c-26bdbf06d1a1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:43.264499 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ab2c76c6-fd1d-4f22-ba2c-26bdbf06d1a1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:43.265378 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ab2c76c6-fd1d-4f22-ba2c-26bdbf06d1a1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:43.266645 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ab2c76c6-fd1d-4f22-ba2c-26bdbf06d1a1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:43.267426 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ab2c76c6-fd1d-4f22-ba2c-26bdbf06d1a1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:43.351911 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-ab2c76c6-fd1d-4f22-ba2c-26bdbf06d1a1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:43.362056 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-ab2c76c6-fd1d-4f22-ba2c-26bdbf06d1a1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:43.364987 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-ab2c76c6-fd1d-4f22-ba2c-26bdbf06d1a1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:43.366563 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-ab2c76c6-fd1d-4f22-ba2c-26bdbf06d1a1 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1342 microversion: 2.20 time: 0.121054 Jul 14 17:59:43.367204 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 382/813] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:59:43 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1342 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:59:44.265023 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-c5e5cde1-1a09-40ed-b29e-149d864ee9f8 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:44.265865 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-c5e5cde1-1a09-40ed-b29e-149d864ee9f8 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:44.274892 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c5e5cde1-1a09-40ed-b29e-149d864ee9f8 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:44.275371 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c5e5cde1-1a09-40ed-b29e-149d864ee9f8 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:44.276256 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c5e5cde1-1a09-40ed-b29e-149d864ee9f8 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:44.276715 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c5e5cde1-1a09-40ed-b29e-149d864ee9f8 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:44.390964 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-b4167c5f-bff2-4c15-b3be-2568189ceb20 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:44.392110 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-b4167c5f-bff2-4c15-b3be-2568189ceb20 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:44.405754 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b4167c5f-bff2-4c15-b3be-2568189ceb20 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:44.406554 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b4167c5f-bff2-4c15-b3be-2568189ceb20 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:44.408701 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b4167c5f-bff2-4c15-b3be-2568189ceb20 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:44.409457 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b4167c5f-bff2-4c15-b3be-2568189ceb20 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:44.442324 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:59:44.462396 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-c5e5cde1-1a09-40ed-b29e-149d864ee9f8 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:44.472370 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-c5e5cde1-1a09-40ed-b29e-149d864ee9f8 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1569 microversion: 2.1 time: 0.213250 Jul 14 17:59:44.473430 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 432/814] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:44 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1569 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:59:44.523975 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-b4167c5f-bff2-4c15-b3be-2568189ceb20 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:44.538059 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-b4167c5f-bff2-4c15-b3be-2568189ceb20 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:44.542056 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-b4167c5f-bff2-4c15-b3be-2568189ceb20 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:44.544291 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-b4167c5f-bff2-4c15-b3be-2568189ceb20 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1340 microversion: 2.20 time: 0.162237 Jul 14 17:59:44.545358 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 383/815] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:59:44 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1340 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:59:45.498695 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-401c14fc-5aa2-435a-8f7b-47641a8cb379 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:45.499307 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-401c14fc-5aa2-435a-8f7b-47641a8cb379 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:45.505949 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-401c14fc-5aa2-435a-8f7b-47641a8cb379 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:45.506405 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-401c14fc-5aa2-435a-8f7b-47641a8cb379 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:45.507181 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-401c14fc-5aa2-435a-8f7b-47641a8cb379 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:45.507622 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-401c14fc-5aa2-435a-8f7b-47641a8cb379 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:45.563862 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-da616891-93ce-4764-a7b3-0eacd5a734d3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:45.564482 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-da616891-93ce-4764-a7b3-0eacd5a734d3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:45.571608 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-da616891-93ce-4764-a7b3-0eacd5a734d3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:45.572087 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-da616891-93ce-4764-a7b3-0eacd5a734d3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:45.572851 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-da616891-93ce-4764-a7b3-0eacd5a734d3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:45.573282 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-da616891-93ce-4764-a7b3-0eacd5a734d3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:45.696225 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-401c14fc-5aa2-435a-8f7b-47641a8cb379 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:45.705747 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-401c14fc-5aa2-435a-8f7b-47641a8cb379 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1569 microversion: 2.1 time: 0.210642 Jul 14 17:59:45.706462 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 433/816] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:45 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1569 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:59:45.754767 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-da616891-93ce-4764-a7b3-0eacd5a734d3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:45.769205 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-da616891-93ce-4764-a7b3-0eacd5a734d3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:45.770783 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-da616891-93ce-4764-a7b3-0eacd5a734d3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:45.771963 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-da616891-93ce-4764-a7b3-0eacd5a734d3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1408 microversion: 2.20 time: 0.212066 Jul 14 17:59:45.772521 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 384/817] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:59:45 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1408 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:59:46.687440 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [req-4e43612f-91ce-48ed-8cd9-470a6da0d06a req-7b92c809-57b4-43f1-b1ee-0b622baff5b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "509b127f-76cb-4358-84a9-457d4e0397ec", "tag": "ab754da5-453e-411a-a26f-b36d77ef6e13"}]} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:59:46.715760 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-4e43612f-91ce-48ed-8cd9-470a6da0d06a req-7b92c809-57b4-43f1-b1ee-0b622baff5b9 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:46.728469 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-4e43612f-91ce-48ed-8cd9-470a6da0d06a req-7b92c809-57b4-43f1-b1ee-0b622baff5b9 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:46.740293 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-c9eadf16-ae1c-4f8b-9bb4-0960dabd12e6 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:46.742640 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-c9eadf16-ae1c-4f8b-9bb4-0960dabd12e6 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:46.755311 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.compute.server_external_events [req-4e43612f-91ce-48ed-8cd9-470a6da0d06a req-7b92c809-57b4-43f1-b1ee-0b622baff5b9 service nova] Creating event network-changed:ab754da5-453e-411a-a26f-b36d77ef6e13 for instance 509b127f-76cb-4358-84a9-457d4e0397ec on hv-cinder-84989 Jul 14 17:59:46.765076 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c9eadf16-ae1c-4f8b-9bb4-0960dabd12e6 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:46.768093 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c9eadf16-ae1c-4f8b-9bb4-0960dabd12e6 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:46.768972 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c9eadf16-ae1c-4f8b-9bb4-0960dabd12e6 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:46.769435 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c9eadf16-ae1c-4f8b-9bb4-0960dabd12e6 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:46.772673 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [req-4e43612f-91ce-48ed-8cd9-470a6da0d06a req-7b92c809-57b4-43f1-b1ee-0b622baff5b9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098197 Jul 14 17:59:46.774394 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 434/818] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 17:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:59:46.794919 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-9dfde480-6efe-41b3-88ee-7740184c0f95 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:46.795910 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-9dfde480-6efe-41b3-88ee-7740184c0f95 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:46.807271 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9dfde480-6efe-41b3-88ee-7740184c0f95 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:46.808093 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9dfde480-6efe-41b3-88ee-7740184c0f95 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:46.809482 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9dfde480-6efe-41b3-88ee-7740184c0f95 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:46.810140 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9dfde480-6efe-41b3-88ee-7740184c0f95 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:47.040198 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-c9eadf16-ae1c-4f8b-9bb4-0960dabd12e6 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:47.040461 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-9dfde480-6efe-41b3-88ee-7740184c0f95 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:47.046231 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:59:47.048112 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-c9eadf16-ae1c-4f8b-9bb4-0960dabd12e6 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1570 microversion: 2.1 time: 0.323836 Jul 14 17:59:47.048726 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 385/819] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:46 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1570 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:59:47.057560 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-9dfde480-6efe-41b3-88ee-7740184c0f95 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:47.060568 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-9dfde480-6efe-41b3-88ee-7740184c0f95 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:47.062584 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-9dfde480-6efe-41b3-88ee-7740184c0f95 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1408 microversion: 2.20 time: 0.275064 Jul 14 17:59:47.063578 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 435/820] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:59:46 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1408 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:59:47.065219 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-62381f17-95e4-4b01-97dc-7730bccf10f5 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:59:47.065797 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-62381f17-95e4-4b01-97dc-7730bccf10f5 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:47.073036 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-62381f17-95e4-4b01-97dc-7730bccf10f5 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:47.073366 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-62381f17-95e4-4b01-97dc-7730bccf10f5 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:47.074378 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-62381f17-95e4-4b01-97dc-7730bccf10f5 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:47.074813 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-62381f17-95e4-4b01-97dc-7730bccf10f5 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:47.152014 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR oslo.messaging._drivers.impl_rabbit [None req-62381f17-95e4-4b01-97dc-7730bccf10f5 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [7a11383a-f91d-4a75-aed3-8e4bd573c32d] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 17:59:48.081824 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-4787e0c2-0546-4efa-94cd-19d154a5757d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:48.082377 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-4787e0c2-0546-4efa-94cd-19d154a5757d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:48.090479 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4787e0c2-0546-4efa-94cd-19d154a5757d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:48.090936 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4787e0c2-0546-4efa-94cd-19d154a5757d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:48.091728 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4787e0c2-0546-4efa-94cd-19d154a5757d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:48.092213 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4787e0c2-0546-4efa-94cd-19d154a5757d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:48.159603 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO oslo.messaging._drivers.impl_rabbit [None req-62381f17-95e4-4b01-97dc-7730bccf10f5 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [7a11383a-f91d-4a75-aed3-8e4bd573c32d] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 34620. Jul 14 17:59:48.163274 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-62381f17-95e4-4b01-97dc-7730bccf10f5 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "POST /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6/action" status: 202 len: 0 microversion: 2.1 time: 1.101860 Jul 14 17:59:48.164831 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 386/821] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Jul 14 17:59:47 2022] POST /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6/action => generated 0 bytes in 1103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 17:59:48.174203 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-f9231233-714d-4b9f-9fbc-693fac4acc1d tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:48.175275 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-f9231233-714d-4b9f-9fbc-693fac4acc1d tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:48.196258 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f9231233-714d-4b9f-9fbc-693fac4acc1d tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:48.196855 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f9231233-714d-4b9f-9fbc-693fac4acc1d tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:48.197786 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f9231233-714d-4b9f-9fbc-693fac4acc1d tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:48.198245 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f9231233-714d-4b9f-9fbc-693fac4acc1d tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:48.254213 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-4787e0c2-0546-4efa-94cd-19d154a5757d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:48.263288 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-4787e0c2-0546-4efa-94cd-19d154a5757d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:48.264849 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-4787e0c2-0546-4efa-94cd-19d154a5757d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:48.266012 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-4787e0c2-0546-4efa-94cd-19d154a5757d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1408 microversion: 2.20 time: 0.188182 Jul 14 17:59:48.266646 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 436/822] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:59:48 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1408 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:59:48.366552 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-f9231233-714d-4b9f-9fbc-693fac4acc1d tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:48.374804 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-f9231233-714d-4b9f-9fbc-693fac4acc1d tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1518 microversion: 2.1 time: 0.205570 Jul 14 17:59:48.375461 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 387/823] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:48 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1518 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:59:49.220410 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [req-6a7c8ebd-2808-44a3-8a70-d5546f1dd620 req-fd20c68b-1902-4914-b793-ffdd7763707b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28947673-5bde-4923-9e70-bec5086fe9c6", "name": "network-vif-unplugged", "status": "completed", "tag": "2f38f011-fe4c-4851-b4df-370ae6045e1f"}]} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:59:49.229355 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-6a7c8ebd-2808-44a3-8a70-d5546f1dd620 req-fd20c68b-1902-4914-b793-ffdd7763707b service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:49.229999 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-6a7c8ebd-2808-44a3-8a70-d5546f1dd620 req-fd20c68b-1902-4914-b793-ffdd7763707b service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:49.250747 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.compute.server_external_events [req-6a7c8ebd-2808-44a3-8a70-d5546f1dd620 req-fd20c68b-1902-4914-b793-ffdd7763707b service nova] Unable to find a host for instance 28947673-5bde-4923-9e70-bec5086fe9c6. Dropping event network-vif-unplugged {{(pid=129471) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 14 17:59:49.252366 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [req-6a7c8ebd-2808-44a3-8a70-d5546f1dd620 req-fd20c68b-1902-4914-b793-ffdd7763707b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035552 Jul 14 17:59:49.253585 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 437/824] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 17:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 14 17:59:49.286107 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-0d93f657-7f6f-4fca-8de5-7c5e4b7c4f19 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:49.286748 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-0d93f657-7f6f-4fca-8de5-7c5e4b7c4f19 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:49.293551 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0d93f657-7f6f-4fca-8de5-7c5e4b7c4f19 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:49.294092 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0d93f657-7f6f-4fca-8de5-7c5e4b7c4f19 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:49.294938 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0d93f657-7f6f-4fca-8de5-7c5e4b7c4f19 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:49.295447 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0d93f657-7f6f-4fca-8de5-7c5e4b7c4f19 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:49.392838 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-ea9e35ae-86f3-41e0-9f81-d751452cbf1a tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:49.393526 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-ea9e35ae-86f3-41e0-9f81-d751452cbf1a tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:49.401124 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ea9e35ae-86f3-41e0-9f81-d751452cbf1a tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:49.401588 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ea9e35ae-86f3-41e0-9f81-d751452cbf1a tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:49.402383 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ea9e35ae-86f3-41e0-9f81-d751452cbf1a tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:49.402818 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ea9e35ae-86f3-41e0-9f81-d751452cbf1a tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:49.455573 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-0d93f657-7f6f-4fca-8de5-7c5e4b7c4f19 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:49.464132 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-0d93f657-7f6f-4fca-8de5-7c5e4b7c4f19 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:49.465688 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-0d93f657-7f6f-4fca-8de5-7c5e4b7c4f19 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:49.466820 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-0d93f657-7f6f-4fca-8de5-7c5e4b7c4f19 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1408 microversion: 2.20 time: 0.185032 Jul 14 17:59:49.467398 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 388/825] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:59:49 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1408 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 17:59:49.550830 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-ea9e35ae-86f3-41e0-9f81-d751452cbf1a tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:49.559221 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-ea9e35ae-86f3-41e0-9f81-d751452cbf1a tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1518 microversion: 2.1 time: 0.170366 Jul 14 17:59:49.559805 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 438/826] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:49 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1518 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:59:50.484316 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-fe50ce0a-3487-43b4-8ff0-c404589fcd6e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:50.484928 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-fe50ce0a-3487-43b4-8ff0-c404589fcd6e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:50.491879 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fe50ce0a-3487-43b4-8ff0-c404589fcd6e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:50.492448 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fe50ce0a-3487-43b4-8ff0-c404589fcd6e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:50.493169 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fe50ce0a-3487-43b4-8ff0-c404589fcd6e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:50.493615 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fe50ce0a-3487-43b4-8ff0-c404589fcd6e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:50.581951 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-bf87de78-43f4-4ff7-9905-ce604c7ff708 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:50.583058 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-bf87de78-43f4-4ff7-9905-ce604c7ff708 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:50.595411 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bf87de78-43f4-4ff7-9905-ce604c7ff708 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:50.596248 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bf87de78-43f4-4ff7-9905-ce604c7ff708 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:50.597563 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bf87de78-43f4-4ff7-9905-ce604c7ff708 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:50.598205 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bf87de78-43f4-4ff7-9905-ce604c7ff708 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:50.630688 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-fe50ce0a-3487-43b4-8ff0-c404589fcd6e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:50.639591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-fe50ce0a-3487-43b4-8ff0-c404589fcd6e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:50.641126 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-fe50ce0a-3487-43b4-8ff0-c404589fcd6e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:50.642250 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-fe50ce0a-3487-43b4-8ff0-c404589fcd6e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1408 microversion: 2.20 time: 0.161915 Jul 14 17:59:50.642861 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 389/827] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:59:50 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:59:50.758990 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-bf87de78-43f4-4ff7-9905-ce604c7ff708 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:50.766969 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-bf87de78-43f4-4ff7-9905-ce604c7ff708 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1518 microversion: 2.1 time: 0.192298 Jul 14 17:59:50.767587 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 439/828] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:50 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1518 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:59:51.662208 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-982d0be0-f553-44a3-8c1c-fd3d3a623eee tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:51.662799 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-982d0be0-f553-44a3-8c1c-fd3d3a623eee tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:51.670180 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-982d0be0-f553-44a3-8c1c-fd3d3a623eee tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:51.670632 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-982d0be0-f553-44a3-8c1c-fd3d3a623eee tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:51.671402 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-982d0be0-f553-44a3-8c1c-fd3d3a623eee tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:51.671837 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-982d0be0-f553-44a3-8c1c-fd3d3a623eee tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:51.789375 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-b92488f4-6ff8-408d-9495-d616913ce2b9 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:51.790937 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-b92488f4-6ff8-408d-9495-d616913ce2b9 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:51.801650 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b92488f4-6ff8-408d-9495-d616913ce2b9 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:51.802401 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b92488f4-6ff8-408d-9495-d616913ce2b9 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:51.803491 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b92488f4-6ff8-408d-9495-d616913ce2b9 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:51.804133 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b92488f4-6ff8-408d-9495-d616913ce2b9 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:51.826961 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-982d0be0-f553-44a3-8c1c-fd3d3a623eee tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:51.839533 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-982d0be0-f553-44a3-8c1c-fd3d3a623eee tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:51.841358 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-982d0be0-f553-44a3-8c1c-fd3d3a623eee tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:51.842593 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-982d0be0-f553-44a3-8c1c-fd3d3a623eee tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1408 microversion: 2.20 time: 0.185116 Jul 14 17:59:51.843515 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 390/829] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:59:51 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1408 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:59:51.955334 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-b92488f4-6ff8-408d-9495-d616913ce2b9 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:51.965367 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-b92488f4-6ff8-408d-9495-d616913ce2b9 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1520 microversion: 2.1 time: 0.181719 Jul 14 17:59:51.966108 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 440/830] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:51 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:59:52.872122 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-9f28facf-f0cf-45c4-8868-247229cdaf34 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:52.872727 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-9f28facf-f0cf-45c4-8868-247229cdaf34 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:52.874614 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell0:SELECT=2 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:59:52.881785 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9f28facf-f0cf-45c4-8868-247229cdaf34 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:52.882477 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9f28facf-f0cf-45c4-8868-247229cdaf34 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:52.883498 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9f28facf-f0cf-45c4-8868-247229cdaf34 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:52.884083 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9f28facf-f0cf-45c4-8868-247229cdaf34 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:52.985742 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell0:SELECT=2 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:59:52.988812 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell0:SELECT=10 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:59:53.041907 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-9f28facf-f0cf-45c4-8868-247229cdaf34 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:53.052642 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-9f28facf-f0cf-45c4-8868-247229cdaf34 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:53.054523 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-9f28facf-f0cf-45c4-8868-247229cdaf34 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:53.055957 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-9f28facf-f0cf-45c4-8868-247229cdaf34 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1408 microversion: 2.20 time: 0.188673 Jul 14 17:59:53.064638 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 391/831] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:59:52 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1408 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:59:53.134774 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-bbc45965-f28b-49a1-bfe7-c64b963e54b2 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:53.136503 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-bbc45965-f28b-49a1-bfe7-c64b963e54b2 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:53.143447 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bbc45965-f28b-49a1-bfe7-c64b963e54b2 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:53.144102 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bbc45965-f28b-49a1-bfe7-c64b963e54b2 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:53.145131 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bbc45965-f28b-49a1-bfe7-c64b963e54b2 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:53.145755 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bbc45965-f28b-49a1-bfe7-c64b963e54b2 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:53.313174 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-bbc45965-f28b-49a1-bfe7-c64b963e54b2 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:53.321250 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-bbc45965-f28b-49a1-bfe7-c64b963e54b2 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1576 microversion: 2.1 time: 0.341221 Jul 14 17:59:53.321933 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 441/832] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:52 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1576 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 17:59:54.074571 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-bc792987-50dc-4d05-a631-5f6d074c52db tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:54.075169 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-bc792987-50dc-4d05-a631-5f6d074c52db tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:54.082883 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-bc792987-50dc-4d05-a631-5f6d074c52db tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:54.083450 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-bc792987-50dc-4d05-a631-5f6d074c52db tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:54.084401 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-bc792987-50dc-4d05-a631-5f6d074c52db tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:54.085040 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-bc792987-50dc-4d05-a631-5f6d074c52db tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:54.253621 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-bc792987-50dc-4d05-a631-5f6d074c52db tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:54.262190 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-bc792987-50dc-4d05-a631-5f6d074c52db tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:54.263721 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-bc792987-50dc-4d05-a631-5f6d074c52db tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:54.264928 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-bc792987-50dc-4d05-a631-5f6d074c52db tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1408 microversion: 2.20 time: 0.194874 Jul 14 17:59:54.265822 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 392/833] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:59:54 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1408 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:59:54.338636 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-6cd8654c-2427-4fb9-ae70-b702e27feac5 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:54.339181 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-6cd8654c-2427-4fb9-ae70-b702e27feac5 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:54.346305 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6cd8654c-2427-4fb9-ae70-b702e27feac5 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:54.346749 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6cd8654c-2427-4fb9-ae70-b702e27feac5 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:54.347533 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6cd8654c-2427-4fb9-ae70-b702e27feac5 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:54.348008 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6cd8654c-2427-4fb9-ae70-b702e27feac5 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:54.480966 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-6cd8654c-2427-4fb9-ae70-b702e27feac5 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:54.488648 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-6cd8654c-2427-4fb9-ae70-b702e27feac5 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1576 microversion: 2.1 time: 0.153980 Jul 14 17:59:54.489228 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 442/834] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:54 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:59:55.282715 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-d3f94e1e-915a-4001-bf55-15eef2199427 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:55.283329 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-d3f94e1e-915a-4001-bf55-15eef2199427 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:55.289917 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d3f94e1e-915a-4001-bf55-15eef2199427 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:55.290374 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d3f94e1e-915a-4001-bf55-15eef2199427 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:55.291147 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d3f94e1e-915a-4001-bf55-15eef2199427 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:55.291592 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d3f94e1e-915a-4001-bf55-15eef2199427 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:55.426065 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-d3f94e1e-915a-4001-bf55-15eef2199427 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:55.434791 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-d3f94e1e-915a-4001-bf55-15eef2199427 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:55.436487 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-d3f94e1e-915a-4001-bf55-15eef2199427 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:55.437653 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-d3f94e1e-915a-4001-bf55-15eef2199427 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1408 microversion: 2.20 time: 0.158898 Jul 14 17:59:55.438210 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 393/835] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:59:55 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:59:55.506290 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-78608165-f813-43f3-a485-bf9d30207bb0 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:55.506898 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-78608165-f813-43f3-a485-bf9d30207bb0 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:55.514209 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-78608165-f813-43f3-a485-bf9d30207bb0 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:55.514657 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-78608165-f813-43f3-a485-bf9d30207bb0 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:55.515421 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-78608165-f813-43f3-a485-bf9d30207bb0 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:55.515850 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-78608165-f813-43f3-a485-bf9d30207bb0 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:55.649919 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-78608165-f813-43f3-a485-bf9d30207bb0 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:55.657941 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-78608165-f813-43f3-a485-bf9d30207bb0 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1576 microversion: 2.1 time: 0.155433 Jul 14 17:59:55.658728 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 443/836] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:55 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:59:55.853750 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-02254fb3-8e7a-4473-ae72-7d6c0fdb0caa req-60798324-4cd9-4732-b5a0-3b444dc7518a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "509b127f-76cb-4358-84a9-457d4e0397ec", "name": "network-vif-plugged", "status": "completed", "tag": "ab754da5-453e-411a-a26f-b36d77ef6e13"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 17:59:55.862664 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-02254fb3-8e7a-4473-ae72-7d6c0fdb0caa req-60798324-4cd9-4732-b5a0-3b444dc7518a service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:55.863014 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-02254fb3-8e7a-4473-ae72-7d6c0fdb0caa req-60798324-4cd9-4732-b5a0-3b444dc7518a service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:55.876960 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-02254fb3-8e7a-4473-ae72-7d6c0fdb0caa req-60798324-4cd9-4732-b5a0-3b444dc7518a service nova] Creating event network-vif-plugged:ab754da5-453e-411a-a26f-b36d77ef6e13 for instance 509b127f-76cb-4358-84a9-457d4e0397ec on hv-cinder-84989 Jul 14 17:59:55.882418 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-02254fb3-8e7a-4473-ae72-7d6c0fdb0caa req-60798324-4cd9-4732-b5a0-3b444dc7518a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034217 Jul 14 17:59:55.883283 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 394/837] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 17:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 17:59:56.455876 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-73a95dfe-3bf3-4213-b29e-e863184c75d6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:56.456508 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-73a95dfe-3bf3-4213-b29e-e863184c75d6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:56.463204 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-73a95dfe-3bf3-4213-b29e-e863184c75d6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:56.463652 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-73a95dfe-3bf3-4213-b29e-e863184c75d6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:56.464447 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-73a95dfe-3bf3-4213-b29e-e863184c75d6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:56.464885 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-73a95dfe-3bf3-4213-b29e-e863184c75d6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:56.618630 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-73a95dfe-3bf3-4213-b29e-e863184c75d6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:56.627148 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-73a95dfe-3bf3-4213-b29e-e863184c75d6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:56.628779 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-73a95dfe-3bf3-4213-b29e-e863184c75d6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:56.629933 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-73a95dfe-3bf3-4213-b29e-e863184c75d6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1408 microversion: 2.20 time: 0.177912 Jul 14 17:59:56.630503 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 444/838] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:59:56 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1408 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:59:56.677488 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-fcf5008f-a080-42e7-85ce-fb918fec8b91 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:56.678170 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-fcf5008f-a080-42e7-85ce-fb918fec8b91 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:56.684473 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fcf5008f-a080-42e7-85ce-fb918fec8b91 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:56.684927 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fcf5008f-a080-42e7-85ce-fb918fec8b91 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:56.685698 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fcf5008f-a080-42e7-85ce-fb918fec8b91 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:56.686141 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fcf5008f-a080-42e7-85ce-fb918fec8b91 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:56.822652 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-fcf5008f-a080-42e7-85ce-fb918fec8b91 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:56.830549 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-fcf5008f-a080-42e7-85ce-fb918fec8b91 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1576 microversion: 2.1 time: 0.157900 Jul 14 17:59:56.831134 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 395/839] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:56 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:59:57.648986 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-cf1a533a-9046-4fcb-b848-9efccaa1f746 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:57.650157 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-cf1a533a-9046-4fcb-b848-9efccaa1f746 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:57.657004 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-cf1a533a-9046-4fcb-b848-9efccaa1f746 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:57.657459 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-cf1a533a-9046-4fcb-b848-9efccaa1f746 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:57.658232 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-cf1a533a-9046-4fcb-b848-9efccaa1f746 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:57.658706 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-cf1a533a-9046-4fcb-b848-9efccaa1f746 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:57.799758 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-cf1a533a-9046-4fcb-b848-9efccaa1f746 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:57.808523 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-cf1a533a-9046-4fcb-b848-9efccaa1f746 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:57.810225 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-cf1a533a-9046-4fcb-b848-9efccaa1f746 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:57.811392 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-cf1a533a-9046-4fcb-b848-9efccaa1f746 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1408 microversion: 2.20 time: 0.166383 Jul 14 17:59:57.811975 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 445/840] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:59:57 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:59:57.847735 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-602c465e-2b5a-4145-9fcf-921e42d5432e tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:57.848435 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-602c465e-2b5a-4145-9fcf-921e42d5432e tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:57.856158 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-602c465e-2b5a-4145-9fcf-921e42d5432e tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:57.856613 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-602c465e-2b5a-4145-9fcf-921e42d5432e tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:57.857390 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-602c465e-2b5a-4145-9fcf-921e42d5432e tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:57.857829 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-602c465e-2b5a-4145-9fcf-921e42d5432e tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:57.989634 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-602c465e-2b5a-4145-9fcf-921e42d5432e tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:57.997165 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-602c465e-2b5a-4145-9fcf-921e42d5432e tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1576 microversion: 2.1 time: 0.153276 Jul 14 17:59:57.997771 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 396/841] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:57 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 17:59:58.828645 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-d1ece84c-bcbf-4ce3-aa22-dc550f53d578 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:58.829266 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-d1ece84c-bcbf-4ce3-aa22-dc550f53d578 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:58.836212 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d1ece84c-bcbf-4ce3-aa22-dc550f53d578 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:58.836780 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d1ece84c-bcbf-4ce3-aa22-dc550f53d578 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:58.837606 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d1ece84c-bcbf-4ce3-aa22-dc550f53d578 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:58.838068 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d1ece84c-bcbf-4ce3-aa22-dc550f53d578 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:58.981567 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-d1ece84c-bcbf-4ce3-aa22-dc550f53d578 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:58.990350 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-d1ece84c-bcbf-4ce3-aa22-dc550f53d578 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:58.991887 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-d1ece84c-bcbf-4ce3-aa22-dc550f53d578 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:58.993173 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-d1ece84c-bcbf-4ce3-aa22-dc550f53d578 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1601 microversion: 2.20 time: 0.168476 Jul 14 17:59:58.994386 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 446/842] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 17:59:58 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1601 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 17:59:59.012480 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-d43af25b-62aa-4596-9484-73a36669bb3d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:59.013096 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-d43af25b-62aa-4596-9484-73a36669bb3d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:59.014253 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-94f971d1-3d93-4e68-b2c5-d9746904f709 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 17:59:59.014942 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-94f971d1-3d93-4e68-b2c5-d9746904f709 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 17:59:59.021079 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d43af25b-62aa-4596-9484-73a36669bb3d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:59.021686 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d43af25b-62aa-4596-9484-73a36669bb3d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:59.022551 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d43af25b-62aa-4596-9484-73a36669bb3d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:59.022995 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d43af25b-62aa-4596-9484-73a36669bb3d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:59.023284 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-94f971d1-3d93-4e68-b2c5-d9746904f709 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:59.023735 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-94f971d1-3d93-4e68-b2c5-d9746904f709 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:59.025121 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-94f971d1-3d93-4e68-b2c5-d9746904f709 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 17:59:59.025570 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-94f971d1-3d93-4e68-b2c5-d9746904f709 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 17:59:59.150537 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-d43af25b-62aa-4596-9484-73a36669bb3d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.141483 Jul 14 17:59:59.151305 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 397/843] 10.222.0.64 () {60 vars in 1315 bytes} [Thu Jul 14 17:59:59 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec/os-interface => generated 285 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 17:59:59.199525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-94f971d1-3d93-4e68-b2c5-d9746904f709 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 17:59:59.207300 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-94f971d1-3d93-4e68-b2c5-d9746904f709 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1576 microversion: 2.1 time: 0.196943 Jul 14 17:59:59.208148 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 447/844] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 17:59:59 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1576 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 18:00:00.107119 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-1e9a2d47-b85b-4cd2-84e2-cc215f4ed553 req-a13df7f6-57d7-4d88-8567-830fe296cb50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "509b127f-76cb-4358-84a9-457d4e0397ec", "tag": "ab754da5-453e-411a-a26f-b36d77ef6e13"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:00:00.116638 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-1e9a2d47-b85b-4cd2-84e2-cc215f4ed553 req-a13df7f6-57d7-4d88-8567-830fe296cb50 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:00.117263 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-1e9a2d47-b85b-4cd2-84e2-cc215f4ed553 req-a13df7f6-57d7-4d88-8567-830fe296cb50 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:00.130383 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-1e9a2d47-b85b-4cd2-84e2-cc215f4ed553 req-a13df7f6-57d7-4d88-8567-830fe296cb50 service nova] Creating event network-changed:ab754da5-453e-411a-a26f-b36d77ef6e13 for instance 509b127f-76cb-4358-84a9-457d4e0397ec on hv-cinder-84989 Jul 14 18:00:00.136113 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-1e9a2d47-b85b-4cd2-84e2-cc215f4ed553 req-a13df7f6-57d7-4d88-8567-830fe296cb50 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033083 Jul 14 18:00:00.136731 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 398/845] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:00:00.225576 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-396d1c2d-3e62-4ee3-a303-9c8b2eff59d7 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:00.226846 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-396d1c2d-3e62-4ee3-a303-9c8b2eff59d7 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:00.233908 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-396d1c2d-3e62-4ee3-a303-9c8b2eff59d7 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:00.234349 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-396d1c2d-3e62-4ee3-a303-9c8b2eff59d7 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:00.235121 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-396d1c2d-3e62-4ee3-a303-9c8b2eff59d7 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:00.235553 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-396d1c2d-3e62-4ee3-a303-9c8b2eff59d7 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:00.371675 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-396d1c2d-3e62-4ee3-a303-9c8b2eff59d7 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:00:00.379489 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-396d1c2d-3e62-4ee3-a303-9c8b2eff59d7 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1576 microversion: 2.1 time: 0.158215 Jul 14 18:00:00.380117 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 448/846] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:00 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:00:01.397955 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-b0b54940-4b75-49fe-a312-d5f53c920958 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:01.398571 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-b0b54940-4b75-49fe-a312-d5f53c920958 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:01.404984 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b0b54940-4b75-49fe-a312-d5f53c920958 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:01.405443 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b0b54940-4b75-49fe-a312-d5f53c920958 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:01.406215 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b0b54940-4b75-49fe-a312-d5f53c920958 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:01.406660 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b0b54940-4b75-49fe-a312-d5f53c920958 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:01.538508 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-b0b54940-4b75-49fe-a312-d5f53c920958 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:00:01.546779 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-b0b54940-4b75-49fe-a312-d5f53c920958 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1576 microversion: 2.1 time: 0.153649 Jul 14 18:00:01.547359 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 399/847] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:01 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:00:02.565142 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-4b036152-5694-46cb-81a5-ee0442315f15 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:02.565694 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-4b036152-5694-46cb-81a5-ee0442315f15 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:02.572273 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4b036152-5694-46cb-81a5-ee0442315f15 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:02.572863 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4b036152-5694-46cb-81a5-ee0442315f15 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:02.573642 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4b036152-5694-46cb-81a5-ee0442315f15 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:02.574081 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4b036152-5694-46cb-81a5-ee0442315f15 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:02.714799 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-4b036152-5694-46cb-81a5-ee0442315f15 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:00:02.722578 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-4b036152-5694-46cb-81a5-ee0442315f15 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1576 microversion: 2.1 time: 0.161691 Jul 14 18:00:02.723215 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 449/848] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:02 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:00:03.740319 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-eb800990-912a-4d10-9572-b1afeee30131 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:03.740985 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-eb800990-912a-4d10-9572-b1afeee30131 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:03.748110 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-eb800990-912a-4d10-9572-b1afeee30131 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:03.748566 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-eb800990-912a-4d10-9572-b1afeee30131 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:03.749367 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-eb800990-912a-4d10-9572-b1afeee30131 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:03.749806 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-eb800990-912a-4d10-9572-b1afeee30131 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:03.876254 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [req-a1c0e751-ca75-4db9-afca-391e2d7a3cd9 req-69399dda-471d-4d35-b6ee-0aefc1be5fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28947673-5bde-4923-9e70-bec5086fe9c6", "name": "network-vif-plugged", "status": "completed", "tag": "2f38f011-fe4c-4851-b4df-370ae6045e1f"}]} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:00:03.887041 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-a1c0e751-ca75-4db9-afca-391e2d7a3cd9 req-69399dda-471d-4d35-b6ee-0aefc1be5fd5 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:03.887764 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-a1c0e751-ca75-4db9-afca-391e2d7a3cd9 req-69399dda-471d-4d35-b6ee-0aefc1be5fd5 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:03.905047 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.compute.server_external_events [req-a1c0e751-ca75-4db9-afca-391e2d7a3cd9 req-69399dda-471d-4d35-b6ee-0aefc1be5fd5 service nova] Creating event network-vif-plugged:2f38f011-fe4c-4851-b4df-370ae6045e1f for instance 28947673-5bde-4923-9e70-bec5086fe9c6 on hv-cinder-84989 Jul 14 18:00:03.905692 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-eb800990-912a-4d10-9572-b1afeee30131 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:00:03.909779 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:00:03.910171 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [req-a1c0e751-ca75-4db9-afca-391e2d7a3cd9 req-69399dda-471d-4d35-b6ee-0aefc1be5fd5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038553 Jul 14 18:00:03.910971 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 450/849] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:00:03.915200 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-eb800990-912a-4d10-9572-b1afeee30131 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1576 microversion: 2.1 time: 0.178817 Jul 14 18:00:03.916053 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 400/850] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:03 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1576 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:00:04.934239 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-0302de12-1663-49b8-bd96-90fd9b9aac35 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:04.935130 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-0302de12-1663-49b8-bd96-90fd9b9aac35 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:04.937200 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:00:04.942978 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0302de12-1663-49b8-bd96-90fd9b9aac35 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:04.943433 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0302de12-1663-49b8-bd96-90fd9b9aac35 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:04.944253 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0302de12-1663-49b8-bd96-90fd9b9aac35 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:04.944699 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0302de12-1663-49b8-bd96-90fd9b9aac35 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:05.128316 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-0302de12-1663-49b8-bd96-90fd9b9aac35 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:00:05.136525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-0302de12-1663-49b8-bd96-90fd9b9aac35 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1576 microversion: 2.1 time: 0.207501 Jul 14 18:00:05.137127 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 451/851] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:04 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1576 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:00:06.154177 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-e0c344d6-0ba3-4c89-80ea-37991b80a4c7 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:06.154827 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-e0c344d6-0ba3-4c89-80ea-37991b80a4c7 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:06.162885 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e0c344d6-0ba3-4c89-80ea-37991b80a4c7 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:06.163332 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e0c344d6-0ba3-4c89-80ea-37991b80a4c7 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:06.164137 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e0c344d6-0ba3-4c89-80ea-37991b80a4c7 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:06.164571 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e0c344d6-0ba3-4c89-80ea-37991b80a4c7 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:06.304789 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-e0c344d6-0ba3-4c89-80ea-37991b80a4c7 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:00:06.313188 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-e0c344d6-0ba3-4c89-80ea-37991b80a4c7 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1576 microversion: 2.1 time: 0.162795 Jul 14 18:00:06.313779 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 401/852] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:06 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:00:07.330643 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-c9bee29e-6328-4b22-8fe0-75290fa5bed0 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:07.331250 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-c9bee29e-6328-4b22-8fe0-75290fa5bed0 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:07.337816 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c9bee29e-6328-4b22-8fe0-75290fa5bed0 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:07.338341 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c9bee29e-6328-4b22-8fe0-75290fa5bed0 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:07.339121 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c9bee29e-6328-4b22-8fe0-75290fa5bed0 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:07.339560 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c9bee29e-6328-4b22-8fe0-75290fa5bed0 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:07.477320 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-c9bee29e-6328-4b22-8fe0-75290fa5bed0 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:00:07.485954 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-c9bee29e-6328-4b22-8fe0-75290fa5bed0 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1563 microversion: 2.1 time: 0.159063 Jul 14 18:00:07.486565 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 452/853] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:07 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:00:32.665634 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-ad0984bb-38f7-458c-873e-1945416df734 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:32.666291 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-ad0984bb-38f7-458c-873e-1945416df734 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:32.668284 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_api:SELECT=45 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:00:32.668947 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=7 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:00:32.674991 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ad0984bb-38f7-458c-873e-1945416df734 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:32.675380 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ad0984bb-38f7-458c-873e-1945416df734 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:32.676184 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ad0984bb-38f7-458c-873e-1945416df734 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:32.676629 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ad0984bb-38f7-458c-873e-1945416df734 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:32.757307 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.objects.instance [None req-ad0984bb-38f7-458c-873e-1945416df734 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lazy-loading 'services' on Instance uuid baa9b44b-200c-4ce7-8026-630090c848b6 {{(pid=129470) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 18:00:32.827234 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-ad0984bb-38f7-458c-873e-1945416df734 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "DELETE /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6/os-volume_attachments/6bf5efd0-ce3f-4821-ada4-7098cda143e6" status: 202 len: 0 microversion: 2.1 time: 0.166235 Jul 14 18:00:32.827868 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 402/854] 10.222.0.64 () {58 vars in 1415 bytes} [Thu Jul 14 18:00:32 2022] DELETE /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6/os-volume_attachments/6bf5efd0-ce3f-4821-ada4-7098cda143e6 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 18:00:32.837272 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-3936f5ec-64b4-4430-890d-90feec575c2a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:32.838261 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-3936f5ec-64b4-4430-890d-90feec575c2a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:32.840553 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_api:SELECT=3 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:00:32.841035 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=94 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:00:32.845942 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3936f5ec-64b4-4430-890d-90feec575c2a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:32.846399 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3936f5ec-64b4-4430-890d-90feec575c2a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:32.847177 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3936f5ec-64b4-4430-890d-90feec575c2a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:32.847617 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3936f5ec-64b4-4430-890d-90feec575c2a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:32.878859 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-3936f5ec-64b4-4430-890d-90feec575c2a tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046273 Jul 14 18:00:32.879428 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 453/855] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Jul 14 18:00:32 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:00:33.892169 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-64c8b0b6-8b94-48fe-9fdd-36d4cab3e2b4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:33.893286 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-64c8b0b6-8b94-48fe-9fdd-36d4cab3e2b4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:33.900620 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-64c8b0b6-8b94-48fe-9fdd-36d4cab3e2b4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:33.901045 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-64c8b0b6-8b94-48fe-9fdd-36d4cab3e2b4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:33.902079 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-64c8b0b6-8b94-48fe-9fdd-36d4cab3e2b4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:33.902659 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-64c8b0b6-8b94-48fe-9fdd-36d4cab3e2b4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:33.934795 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-64c8b0b6-8b94-48fe-9fdd-36d4cab3e2b4 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047932 Jul 14 18:00:33.935374 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 403/856] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Jul 14 18:00:33 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:00:34.582821 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-fc171e47-01e8-4437-9e47-914e39885cf5 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:34.583856 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-fc171e47-01e8-4437-9e47-914e39885cf5 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:34.590383 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fc171e47-01e8-4437-9e47-914e39885cf5 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:34.590838 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fc171e47-01e8-4437-9e47-914e39885cf5 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:34.591605 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fc171e47-01e8-4437-9e47-914e39885cf5 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:34.592093 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fc171e47-01e8-4437-9e47-914e39885cf5 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:34.619895 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-fc171e47-01e8-4437-9e47-914e39885cf5 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041548 Jul 14 18:00:34.620464 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 454/857] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Jul 14 18:00:34 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 18:00:34.676353 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-1347623a-4a8f-4c8a-9325-fc96054af61e tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:34.676883 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-1347623a-4a8f-4c8a-9325-fc96054af61e tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:34.683450 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1347623a-4a8f-4c8a-9325-fc96054af61e tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:34.683900 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1347623a-4a8f-4c8a-9325-fc96054af61e tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:34.684712 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1347623a-4a8f-4c8a-9325-fc96054af61e tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:34.685152 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1347623a-4a8f-4c8a-9325-fc96054af61e tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:34.709992 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-1347623a-4a8f-4c8a-9325-fc96054af61e tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Going to try to terminate instance {{(pid=129470) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 18:00:34.786353 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-1347623a-4a8f-4c8a-9325-fc96054af61e tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "DELETE /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 204 len: 0 microversion: 2.1 time: 0.113530 Jul 14 18:00:34.787242 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 404/858] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Jul 14 18:00:34 2022] DELETE /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 18:00:34.795074 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-bf947947-a3eb-40b3-a75c-49bd237a58d8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:34.795709 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-bf947947-a3eb-40b3-a75c-49bd237a58d8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:34.801750 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bf947947-a3eb-40b3-a75c-49bd237a58d8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:34.802212 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bf947947-a3eb-40b3-a75c-49bd237a58d8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:34.802971 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bf947947-a3eb-40b3-a75c-49bd237a58d8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:34.803410 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bf947947-a3eb-40b3-a75c-49bd237a58d8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:34.935654 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-bf947947-a3eb-40b3-a75c-49bd237a58d8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:00:34.943369 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-bf947947-a3eb-40b3-a75c-49bd237a58d8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1672 microversion: 2.1 time: 0.152084 Jul 14 18:00:34.943965 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 455/859] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:34 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:00:34.947461 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-05518b8e-02b5-4640-a65f-939786fddd7c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:34.948556 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-05518b8e-02b5-4640-a65f-939786fddd7c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:34.955231 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-05518b8e-02b5-4640-a65f-939786fddd7c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:34.955681 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-05518b8e-02b5-4640-a65f-939786fddd7c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:34.956537 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-05518b8e-02b5-4640-a65f-939786fddd7c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:34.956982 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-05518b8e-02b5-4640-a65f-939786fddd7c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:34.985247 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-05518b8e-02b5-4640-a65f-939786fddd7c tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042681 Jul 14 18:00:34.985805 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 405/860] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Jul 14 18:00:34 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 18:00:35.063657 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-124b67b9-c9df-4768-b0ae-4a3df3bd68b9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:35.064135 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-124b67b9-c9df-4768-b0ae-4a3df3bd68b9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:35.070307 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-124b67b9-c9df-4768-b0ae-4a3df3bd68b9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:35.070755 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-124b67b9-c9df-4768-b0ae-4a3df3bd68b9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:35.071512 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-124b67b9-c9df-4768-b0ae-4a3df3bd68b9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:35.071964 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-124b67b9-c9df-4768-b0ae-4a3df3bd68b9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:35.099171 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-124b67b9-c9df-4768-b0ae-4a3df3bd68b9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Going to try to terminate instance {{(pid=129471) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 18:00:35.173508 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-124b67b9-c9df-4768-b0ae-4a3df3bd68b9 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "DELETE /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 204 len: 0 microversion: 2.1 time: 0.113478 Jul 14 18:00:35.174080 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 456/861] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Jul 14 18:00:35 2022] DELETE /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 18:00:35.182550 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-81bcafdd-a768-4d26-9d2e-8d4fd411d082 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:35.183157 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-81bcafdd-a768-4d26-9d2e-8d4fd411d082 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:35.189182 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-81bcafdd-a768-4d26-9d2e-8d4fd411d082 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:35.189627 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-81bcafdd-a768-4d26-9d2e-8d4fd411d082 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:35.190382 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-81bcafdd-a768-4d26-9d2e-8d4fd411d082 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:35.190816 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-81bcafdd-a768-4d26-9d2e-8d4fd411d082 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:35.316610 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-81bcafdd-a768-4d26-9d2e-8d4fd411d082 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:00:35.324070 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-81bcafdd-a768-4d26-9d2e-8d4fd411d082 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 200 len: 1688 microversion: 2.1 time: 0.145902 Jul 14 18:00:35.324639 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 406/862] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:35 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 1688 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:00:35.962412 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-5d2935da-b00a-47e0-824a-be651597c8b7 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:35.963125 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-5d2935da-b00a-47e0-824a-be651597c8b7 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:35.969902 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5d2935da-b00a-47e0-824a-be651597c8b7 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:35.970351 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5d2935da-b00a-47e0-824a-be651597c8b7 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:35.971130 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5d2935da-b00a-47e0-824a-be651597c8b7 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:35.971578 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5d2935da-b00a-47e0-824a-be651597c8b7 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:36.105379 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-5d2935da-b00a-47e0-824a-be651597c8b7 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:00:36.112878 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-5d2935da-b00a-47e0-824a-be651597c8b7 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1672 microversion: 2.1 time: 0.155367 Jul 14 18:00:36.113447 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 457/863] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:35 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:00:36.341596 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-56498843-9009-4c63-85e8-2f592ccdee0b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:36.342140 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-56498843-9009-4c63-85e8-2f592ccdee0b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:36.348920 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-56498843-9009-4c63-85e8-2f592ccdee0b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:36.349370 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-56498843-9009-4c63-85e8-2f592ccdee0b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:36.350156 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-56498843-9009-4c63-85e8-2f592ccdee0b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:36.350591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-56498843-9009-4c63-85e8-2f592ccdee0b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:36.483793 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-56498843-9009-4c63-85e8-2f592ccdee0b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:00:36.492105 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-56498843-9009-4c63-85e8-2f592ccdee0b tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 200 len: 1688 microversion: 2.1 time: 0.153833 Jul 14 18:00:36.492686 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 407/864] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:36 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:00:37.130639 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-e8f2e7fd-f1a9-4743-913b-0217dd636587 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:37.131783 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-e8f2e7fd-f1a9-4743-913b-0217dd636587 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:37.138456 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e8f2e7fd-f1a9-4743-913b-0217dd636587 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:37.138915 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e8f2e7fd-f1a9-4743-913b-0217dd636587 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:37.139697 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e8f2e7fd-f1a9-4743-913b-0217dd636587 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:37.140176 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e8f2e7fd-f1a9-4743-913b-0217dd636587 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:37.273655 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-e8f2e7fd-f1a9-4743-913b-0217dd636587 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:00:37.281547 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-e8f2e7fd-f1a9-4743-913b-0217dd636587 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1672 microversion: 2.1 time: 0.154674 Jul 14 18:00:37.282123 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 458/865] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:37 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:00:37.509967 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-e7a87c0e-ed28-4912-b25c-706e0796ab99 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:37.510579 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-e7a87c0e-ed28-4912-b25c-706e0796ab99 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:37.517349 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e7a87c0e-ed28-4912-b25c-706e0796ab99 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:37.517802 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e7a87c0e-ed28-4912-b25c-706e0796ab99 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:37.518579 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e7a87c0e-ed28-4912-b25c-706e0796ab99 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:37.519012 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e7a87c0e-ed28-4912-b25c-706e0796ab99 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:37.653592 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-e7a87c0e-ed28-4912-b25c-706e0796ab99 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:00:37.661232 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-e7a87c0e-ed28-4912-b25c-706e0796ab99 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 200 len: 1688 microversion: 2.1 time: 0.155678 Jul 14 18:00:37.661806 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 408/866] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:37 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:00:38.298629 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-c9763cb3-ecfc-435c-8e1f-5bf6b9e500f9 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:38.299235 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-c9763cb3-ecfc-435c-8e1f-5bf6b9e500f9 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:38.306165 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c9763cb3-ecfc-435c-8e1f-5bf6b9e500f9 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:38.306615 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c9763cb3-ecfc-435c-8e1f-5bf6b9e500f9 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:38.307370 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c9763cb3-ecfc-435c-8e1f-5bf6b9e500f9 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:38.307797 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c9763cb3-ecfc-435c-8e1f-5bf6b9e500f9 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:38.436377 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-c9763cb3-ecfc-435c-8e1f-5bf6b9e500f9 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:00:38.444600 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-c9763cb3-ecfc-435c-8e1f-5bf6b9e500f9 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1672 microversion: 2.1 time: 0.149858 Jul 14 18:00:38.445166 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 459/867] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:38 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:00:38.678271 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-df57132d-e0f0-4c75-a3a9-ec7190ed26fe tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:38.678814 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-df57132d-e0f0-4c75-a3a9-ec7190ed26fe tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:38.685346 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-df57132d-e0f0-4c75-a3a9-ec7190ed26fe tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:38.685831 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-df57132d-e0f0-4c75-a3a9-ec7190ed26fe tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:38.686602 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-df57132d-e0f0-4c75-a3a9-ec7190ed26fe tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:38.687044 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-df57132d-e0f0-4c75-a3a9-ec7190ed26fe tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:38.819544 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-df57132d-e0f0-4c75-a3a9-ec7190ed26fe tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:00:38.827472 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-df57132d-e0f0-4c75-a3a9-ec7190ed26fe tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 200 len: 1688 microversion: 2.1 time: 0.153140 Jul 14 18:00:38.828092 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 409/868] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:38 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:00:39.462688 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-2c5ea925-1b5b-4da5-8240-da8b9238473e tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:39.463296 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-2c5ea925-1b5b-4da5-8240-da8b9238473e tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:39.470356 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2c5ea925-1b5b-4da5-8240-da8b9238473e tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:39.470809 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2c5ea925-1b5b-4da5-8240-da8b9238473e tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:39.471784 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2c5ea925-1b5b-4da5-8240-da8b9238473e tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:39.472250 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2c5ea925-1b5b-4da5-8240-da8b9238473e tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:39.603872 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-2c5ea925-1b5b-4da5-8240-da8b9238473e tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:00:39.611370 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-2c5ea925-1b5b-4da5-8240-da8b9238473e tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1672 microversion: 2.1 time: 0.152613 Jul 14 18:00:39.611960 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 460/869] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:39 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:00:39.845244 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-d8a48871-9299-487b-af5a-f2e12b4e7d72 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:39.845840 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-d8a48871-9299-487b-af5a-f2e12b4e7d72 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:39.852393 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d8a48871-9299-487b-af5a-f2e12b4e7d72 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:39.852842 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d8a48871-9299-487b-af5a-f2e12b4e7d72 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:39.853618 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d8a48871-9299-487b-af5a-f2e12b4e7d72 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:39.854053 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d8a48871-9299-487b-af5a-f2e12b4e7d72 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:39.982632 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-d8a48871-9299-487b-af5a-f2e12b4e7d72 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:00:39.990324 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-d8a48871-9299-487b-af5a-f2e12b4e7d72 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 200 len: 1688 microversion: 2.1 time: 0.148930 Jul 14 18:00:39.990908 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 410/870] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:39 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 1688 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:00:40.629309 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-509f17d3-e34a-4361-a003-7aa80d8a5c86 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:40.629939 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-509f17d3-e34a-4361-a003-7aa80d8a5c86 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:40.637638 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-509f17d3-e34a-4361-a003-7aa80d8a5c86 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:40.638094 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-509f17d3-e34a-4361-a003-7aa80d8a5c86 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:40.638905 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-509f17d3-e34a-4361-a003-7aa80d8a5c86 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:40.639319 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-509f17d3-e34a-4361-a003-7aa80d8a5c86 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:40.698634 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-450a427e-fe7f-4813-b511-a9eacc36f5b7 req-1a4535d6-4d24-429e-999b-737e36abb493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e8e31fc-eea3-4666-90e3-1898f92cf6ba", "name": "network-vif-deleted", "tag": "b2e39af7-f885-4b8c-8d62-c542f2b4d4e2"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:00:40.723679 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-450a427e-fe7f-4813-b511-a9eacc36f5b7 req-1a4535d6-4d24-429e-999b-737e36abb493 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:40.726331 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-450a427e-fe7f-4813-b511-a9eacc36f5b7 req-1a4535d6-4d24-429e-999b-737e36abb493 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:40.736006 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-509f17d3-e34a-4361-a003-7aa80d8a5c86 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:00:40.745847 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-450a427e-fe7f-4813-b511-a9eacc36f5b7 req-1a4535d6-4d24-429e-999b-737e36abb493 service nova] Creating event network-vif-deleted:b2e39af7-f885-4b8c-8d62-c542f2b4d4e2 for instance 1e8e31fc-eea3-4666-90e3-1898f92cf6ba on hv-cinder-84989 Jul 14 18:00:40.746869 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-509f17d3-e34a-4361-a003-7aa80d8a5c86 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1605 microversion: 2.1 time: 0.122003 Jul 14 18:00:40.747854 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 461/871] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:40 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1605 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:00:40.762304 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-450a427e-fe7f-4813-b511-a9eacc36f5b7 req-1a4535d6-4d24-429e-999b-737e36abb493 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073756 Jul 14 18:00:40.763040 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 411/872] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:00:41.008341 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-a0346643-6b71-499b-942a-6bb56a682240 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:41.009588 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-a0346643-6b71-499b-942a-6bb56a682240 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:41.020188 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a0346643-6b71-499b-942a-6bb56a682240 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:41.020642 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a0346643-6b71-499b-942a-6bb56a682240 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:41.021456 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a0346643-6b71-499b-942a-6bb56a682240 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:41.021891 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a0346643-6b71-499b-942a-6bb56a682240 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:41.137509 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-a0346643-6b71-499b-942a-6bb56a682240 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:00:41.161361 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-a0346643-6b71-499b-942a-6bb56a682240 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 200 len: 1620 microversion: 2.1 time: 0.158467 Jul 14 18:00:41.163302 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 462/873] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:41 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 1620 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:00:41.765705 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-9a6fe346-7c1e-4a67-a097-80233b60ae5c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:41.766407 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-9a6fe346-7c1e-4a67-a097-80233b60ae5c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:41.777672 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9a6fe346-7c1e-4a67-a097-80233b60ae5c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:41.778148 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9a6fe346-7c1e-4a67-a097-80233b60ae5c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:41.778971 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9a6fe346-7c1e-4a67-a097-80233b60ae5c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:41.779418 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9a6fe346-7c1e-4a67-a097-80233b60ae5c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:41.827364 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9a6fe346-7c1e-4a67-a097-80233b60ae5c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:41.828117 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9a6fe346-7c1e-4a67-a097-80233b60ae5c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:41.828767 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.objects.instance [None req-9a6fe346-7c1e-4a67-a097-80233b60ae5c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lazy-loading 'fault' on Instance uuid 1e8e31fc-eea3-4666-90e3-1898f92cf6ba {{(pid=129470) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 18:00:41.885068 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-9a6fe346-7c1e-4a67-a097-80233b60ae5c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:00:41.893418 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-9a6fe346-7c1e-4a67-a097-80233b60ae5c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 200 len: 1327 microversion: 2.1 time: 0.131862 Jul 14 18:00:41.894371 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 412/874] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:41 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 1327 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:00:42.179270 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-595f6da7-c17d-4798-a7ec-a7a4d6f8217f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:42.179799 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-595f6da7-c17d-4798-a7ec-a7a4d6f8217f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: baa9b44b-200c-4ce7-8026-630090c848b6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:42.186289 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-595f6da7-c17d-4798-a7ec-a7a4d6f8217f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:42.186741 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-595f6da7-c17d-4798-a7ec-a7a4d6f8217f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:42.187515 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-595f6da7-c17d-4798-a7ec-a7a4d6f8217f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:42.187978 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-595f6da7-c17d-4798-a7ec-a7a4d6f8217f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:42.201678 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.wsgi [None req-595f6da7-c17d-4798-a7ec-a7a4d6f8217f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] HTTP exception thrown: Instance baa9b44b-200c-4ce7-8026-630090c848b6 could not be found. Jul 14 18:00:42.203339 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-595f6da7-c17d-4798-a7ec-a7a4d6f8217f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Request method failure captured: Jul 14 18:00:42.203339 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: request: GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 HTTP/1.1 Jul 14 18:00:42.203339 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept: application/json Jul 14 18:00:42.203339 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept-Encoding: identity Jul 14 18:00:42.203339 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Connection: close Jul 14 18:00:42.203339 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Length: 0 Jul 14 18:00:42.203339 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Type: application/json Jul 14 18:00:42.203339 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Host: 10.222.0.64 Jul 14 18:00:42.203339 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Openstack-System-Scope: None Jul 14 18:00:42.203339 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: User-Agent: python-urllib3/1.26.9 Jul 14 18:00:42.203339 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Auth-Token: gAAAAABi0FfL6emn5hg2SNahQObVYYShIrtH-f3Fd-CAp1ihyP3qn1qpxmH7972vS_WzpDPVTAyMR2SXNmzXKBpQQN8nUKpUEX5KNrSOtzqNYhKbT7o6DhLBkpLmyAxCB9QiIEyoBCjGxn1ftlUyU7aDfEm3oaSulrngFZzD1cGUryIY_p8LWw4 Jul 14 18:00:42.203339 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Id: None Jul 14 18:00:42.203339 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Name: None Jul 14 18:00:42.203339 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Identity-Status: Confirmed Jul 14 18:00:42.203339 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Is-Admin-Project: True Jul 14 18:00:42.203339 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Id: default Jul 14 18:00:42.203339 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Name: Default Jul 14 18:00:42.203339 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Id: ab58d5c4c0194b58ad47dd5e4494389f Jul 14 18:00:42.203339 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-763337508 Jul 14 18:00:42.203339 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Role: reader,member Jul 14 18:00:42.203339 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Roles: reader,member Jul 14 18:00:42.205430 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ab58d5c4c0194b58ad47dd5e4494389f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ab58d5c4c0194b58ad47dd5e4494389f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ab58d5c4c0194b58ad47dd5e4494389f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ab58d5c4c0194b58ad47dd5e4494389f", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:00:42.205430 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant: tempest-ServerRescueNegativeTestJSON-763337508 Jul 14 18:00:42.205430 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Id: ab58d5c4c0194b58ad47dd5e4494389f Jul 14 18:00:42.205430 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-763337508 Jul 14 18:00:42.205430 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User: tempest-ServerRescueNegativeTestJSON-763337508-project Jul 14 18:00:42.205430 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Id: default Jul 14 18:00:42.205430 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Name: Default Jul 14 18:00:42.205430 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Id: 52c794c11ab74f9ca9bad75857043a62 Jul 14 18:00:42.205430 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Name: tempest-ServerRescueNegativeTestJSON-763337508-project Jul 14 18:00:42.205430 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: method: > Jul 14 18:00:42.205430 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: exception: Instance baa9b44b-200c-4ce7-8026-630090c848b6 could not be found. Jul 14 18:00:42.205430 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: action_args: {'id': 'baa9b44b-200c-4ce7-8026-630090c848b6'} Jul 14 18:00:42.206269 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:00:42.206269 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:00:42.206269 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 18:00:42.206269 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 18:00:42.206269 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 18:00:42.206269 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 18:00:42.206269 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 18:00:42.206269 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 18:00:42.206269 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 18:00:42.206269 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 18:00:42.206269 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baa9b44b-200c-4ce7-8026-630090c848b6 could not be found. Jul 14 18:00:42.206269 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:00:42.206269 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:00:42.206269 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:00:42.206269 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:00:42.206269 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:00:42.206269 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:00:42.206269 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:00:42.206269 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:00:42.206269 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:00:42.207589 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:00:42.207589 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 18:00:42.207589 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 18:00:42.207589 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 18:00:42.207589 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 18:00:42.207589 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 18:00:42.207589 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 18:00:42.207589 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baa9b44b-200c-4ce7-8026-630090c848b6 could not be found. Jul 14 18:00:42.207589 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:00:42.207589 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:00:42.207589 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:00:42.207589 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:00:42.207589 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:00:42.207589 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:00:42.207589 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 18:00:42.207589 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 18:00:42.207589 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baa9b44b-200c-4ce7-8026-630090c848b6 could not be found. Jul 14 18:00:42.207589 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:00:42.208764 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-595f6da7-c17d-4798-a7ec-a7a4d6f8217f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Returning 404 to user: Instance baa9b44b-200c-4ce7-8026-630090c848b6 could not be found. {{(pid=129471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:00:42.208764 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-595f6da7-c17d-4798-a7ec-a7a4d6f8217f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6" status: 404 len: 111 microversion: 2.1 time: 0.029432 Jul 14 18:00:42.208764 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 463/875] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:42 2022] GET /compute/v2.1/servers/baa9b44b-200c-4ce7-8026-630090c848b6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 18:00:42.213942 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-5bc7f444-a30d-41fe-83c6-36a45f172e67 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '.version_select at 0x7f1383f10280>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:42.237357 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-5bc7f444-a30d-41fe-83c6-36a45f172e67 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-637825620" status: 202 len: 0 microversion: 2.1 time: 0.027142 Jul 14 18:00:42.237937 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 413/876] 10.222.0.64 () {58 vars in 1217 bytes} [Thu Jul 14 18:00:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-637825620 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 18:00:42.790031 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [req-405c5a66-c16c-44e4-9918-c4e3c4c07f84 req-0e998246-c9a8-4792-b441-cd2b27b1b67f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baa9b44b-200c-4ce7-8026-630090c848b6", "name": "network-vif-deleted", "tag": "213c9b29-ab9e-4c3a-9f2c-712786e0d8e0"}]} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:00:42.798538 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-405c5a66-c16c-44e4-9918-c4e3c4c07f84 req-0e998246-c9a8-4792-b441-cd2b27b1b67f service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:42.799096 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-405c5a66-c16c-44e4-9918-c4e3c4c07f84 req-0e998246-c9a8-4792-b441-cd2b27b1b67f service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:42.810059 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.compute.server_external_events [req-405c5a66-c16c-44e4-9918-c4e3c4c07f84 req-0e998246-c9a8-4792-b441-cd2b27b1b67f service nova] Creating event network-vif-deleted:213c9b29-ab9e-4c3a-9f2c-712786e0d8e0 for instance baa9b44b-200c-4ce7-8026-630090c848b6 on hv-cinder-84989 Jul 14 18:00:42.815730 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [req-405c5a66-c16c-44e4-9918-c4e3c4c07f84 req-0e998246-c9a8-4792-b441-cd2b27b1b67f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029300 Jul 14 18:00:42.816479 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 464/877] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:00:42.912110 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-8ffa2dc3-c59a-4848-afd8-c6d13c31a4db tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:42.912829 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-8ffa2dc3-c59a-4848-afd8-c6d13c31a4db tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:42.919974 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8ffa2dc3-c59a-4848-afd8-c6d13c31a4db tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:42.920432 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8ffa2dc3-c59a-4848-afd8-c6d13c31a4db tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:42.921241 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8ffa2dc3-c59a-4848-afd8-c6d13c31a4db tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:42.921703 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8ffa2dc3-c59a-4848-afd8-c6d13c31a4db tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:42.935063 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.wsgi [None req-8ffa2dc3-c59a-4848-afd8-c6d13c31a4db tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] HTTP exception thrown: Instance 1e8e31fc-eea3-4666-90e3-1898f92cf6ba could not be found. Jul 14 18:00:42.936729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-8ffa2dc3-c59a-4848-afd8-c6d13c31a4db tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Request method failure captured: Jul 14 18:00:42.936729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: request: GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba HTTP/1.1 Jul 14 18:00:42.936729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept: application/json Jul 14 18:00:42.936729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept-Encoding: identity Jul 14 18:00:42.936729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Connection: close Jul 14 18:00:42.936729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Length: 0 Jul 14 18:00:42.936729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Type: application/json Jul 14 18:00:42.936729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Host: 10.222.0.64 Jul 14 18:00:42.936729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Openstack-System-Scope: None Jul 14 18:00:42.936729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: User-Agent: python-urllib3/1.26.9 Jul 14 18:00:42.936729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Auth-Token: gAAAAABi0FfHvR6PpIhkosQ1X7_9NpTPXG5F1g5Xt3oqAF0Fb1smJZRvXMYjeWtOXuLV8qjGuJGvzKJ_Q6ZOWEKnG6CONblT1ibngkmWiXLgdhBRRvy0OiDg3hLogpV8lb8YjEQnCidxPy7H0uj1770GzHRBkq97CkOGykDSSpF5meH0d4NIoBA Jul 14 18:00:42.936729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Id: None Jul 14 18:00:42.936729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Name: None Jul 14 18:00:42.936729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Identity-Status: Confirmed Jul 14 18:00:42.936729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Is-Admin-Project: True Jul 14 18:00:42.936729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Id: default Jul 14 18:00:42.936729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Name: Default Jul 14 18:00:42.936729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Id: e51408d5653d460f82009b65e238281f Jul 14 18:00:42.936729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Name: tempest-AttachVolumeTestJSON-564883252 Jul 14 18:00:42.936729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Role: reader,member Jul 14 18:00:42.936729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Roles: reader,member Jul 14 18:00:42.938552 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e51408d5653d460f82009b65e238281f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e51408d5653d460f82009b65e238281f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e51408d5653d460f82009b65e238281f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e51408d5653d460f82009b65e238281f", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:00:42.938552 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant: tempest-AttachVolumeTestJSON-564883252 Jul 14 18:00:42.938552 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Id: e51408d5653d460f82009b65e238281f Jul 14 18:00:42.938552 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Name: tempest-AttachVolumeTestJSON-564883252 Jul 14 18:00:42.938552 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User: tempest-AttachVolumeTestJSON-564883252-project Jul 14 18:00:42.938552 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Id: default Jul 14 18:00:42.938552 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Name: Default Jul 14 18:00:42.938552 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Id: 84c38f6ff5af4ba79c80fb581baacb0b Jul 14 18:00:42.938552 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Name: tempest-AttachVolumeTestJSON-564883252-project Jul 14 18:00:42.938552 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: method: > Jul 14 18:00:42.938552 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: exception: Instance 1e8e31fc-eea3-4666-90e3-1898f92cf6ba could not be found. Jul 14 18:00:42.938552 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: action_args: {'id': '1e8e31fc-eea3-4666-90e3-1898f92cf6ba'} Jul 14 18:00:42.939578 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:00:42.939578 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:00:42.939578 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 18:00:42.939578 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 18:00:42.939578 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 18:00:42.939578 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 18:00:42.939578 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 18:00:42.939578 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 18:00:42.939578 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 18:00:42.939578 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 18:00:42.939578 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e8e31fc-eea3-4666-90e3-1898f92cf6ba could not be found. Jul 14 18:00:42.939578 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:00:42.939578 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:00:42.939578 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:00:42.939578 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:00:42.939578 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:00:42.939578 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:00:42.939578 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:00:42.939578 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:00:42.939578 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:00:42.941134 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:00:42.941134 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 18:00:42.941134 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 18:00:42.941134 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 18:00:42.941134 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 18:00:42.941134 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 18:00:42.941134 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 18:00:42.941134 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e8e31fc-eea3-4666-90e3-1898f92cf6ba could not be found. Jul 14 18:00:42.941134 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:00:42.941134 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:00:42.941134 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:00:42.941134 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:00:42.941134 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:00:42.941134 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:00:42.941134 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 18:00:42.941134 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 18:00:42.941134 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e8e31fc-eea3-4666-90e3-1898f92cf6ba could not be found. Jul 14 18:00:42.941134 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:00:42.942732 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-8ffa2dc3-c59a-4848-afd8-c6d13c31a4db tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Returning 404 to user: Instance 1e8e31fc-eea3-4666-90e3-1898f92cf6ba could not be found. {{(pid=129470) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:00:42.942732 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-8ffa2dc3-c59a-4848-afd8-c6d13c31a4db tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 404 len: 111 microversion: 2.1 time: 0.031250 Jul 14 18:00:42.942732 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 414/878] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:42 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 18:00:42.948098 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-d859d448-a1ea-48bb-a415-821eaad77dc3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '.version_select at 0x7f137b6ee550>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:42.965763 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-d859d448-a1ea-48bb-a415-821eaad77dc3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1892899044" status: 202 len: 0 microversion: 2.1 time: 0.022457 Jul 14 18:00:42.966322 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 465/879] 10.222.0.64 () {58 vars in 1220 bytes} [Thu Jul 14 18:00:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1892899044 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 18:00:43.598744 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-faee8373-07e6-41a0-909d-aa7a828a4dcd tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Action: 'create', calling method: .version_select at 0x7f1380045ca0>, body: {"keypair": {"name": "tempest-keypair-914657154", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdGeAIZd3MEq14n4A1F4GMR0Y6Lu3xg+EW07yWQgfKlrimgPd8mNeV1aZXaMbOhM2m5Xy0prQs7nOAcoPFam37ayhLbVXBiP/ZiyCNLcMrmNZCipiyDMS7YDPsCFEWM/A=="}} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:00:43.612991 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.quota [None req-faee8373-07e6-41a0-909d-aa7a828a4dcd tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Getting quotas for project e51408d5653d460f82009b65e238281f. Resources: {'key_pairs'} {{(pid=129470) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 18:00:43.616880 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.quota [None req-faee8373-07e6-41a0-909d-aa7a828a4dcd tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Getting quotas for user 84c38f6ff5af4ba79c80fb581baacb0b and project e51408d5653d460f82009b65e238281f. Resources: {'key_pairs'} {{(pid=129470) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 18:00:43.638522 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-faee8373-07e6-41a0-909d-aa7a828a4dcd tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.043679 Jul 14 18:00:43.639126 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 415/880] 10.222.0.64 () {60 vars in 1158 bytes} [Thu Jul 14 18:00:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:00:44.874746 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-b7aba074-0676-4a51-83d5-cad4a6b9e953 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-514462099", "imageRef": "cf1f5d8c-9e49-4272-8e19-8e3c587056e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c730473d-7caa-417d-8844-88c6549d7fd2"}], "security_groups": [{"name": "tempest-securitygroup--14508365"}], "key_name": "tempest-keypair-914657154", "user_data": "}} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:00:44.986947 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.network.neutron [None req-b7aba074-0676-4a51-83d5-cad4a6b9e953 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] validate_networks() for [('c730473d-7caa-417d-8844-88c6549d7fd2', None, None, None, None, None)] {{(pid=129471) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 18:00:45.099851 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-675413e2-338c-4c76-9f79-8478b20debd1 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:45.100383 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-675413e2-338c-4c76-9f79-8478b20debd1 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:45.108118 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-675413e2-338c-4c76-9f79-8478b20debd1 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:45.108521 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-675413e2-338c-4c76-9f79-8478b20debd1 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:45.109286 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-675413e2-338c-4c76-9f79-8478b20debd1 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:45.109723 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-675413e2-338c-4c76-9f79-8478b20debd1 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:45.135207 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-675413e2-338c-4c76-9f79-8478b20debd1 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Going to try to terminate instance {{(pid=129470) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 18:00:45.214344 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-675413e2-338c-4c76-9f79-8478b20debd1 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "DELETE /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 204 len: 0 microversion: 2.1 time: 0.117904 Jul 14 18:00:45.215295 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 416/881] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Jul 14 18:00:45 2022] DELETE /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 18:00:45.225321 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-dc244ab2-35bd-498c-a96a-6c940a03c692 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:45.226026 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-dc244ab2-35bd-498c-a96a-6c940a03c692 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:45.232320 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-dc244ab2-35bd-498c-a96a-6c940a03c692 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:45.233306 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-dc244ab2-35bd-498c-a96a-6c940a03c692 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:45.234092 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-dc244ab2-35bd-498c-a96a-6c940a03c692 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:45.234538 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-dc244ab2-35bd-498c-a96a-6c940a03c692 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:45.254825 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:00:45.629115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-dc244ab2-35bd-498c-a96a-6c940a03c692 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:00:45.636463 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-dc244ab2-35bd-498c-a96a-6c940a03c692 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1507 microversion: 2.1 time: 0.415296 Jul 14 18:00:45.637040 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 417/882] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:45 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1507 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:00:45.651193 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-b7aba074-0676-4a51-83d5-cad4a6b9e953 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Flavor limits 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 18:00:45.651619 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-b7aba074-0676-4a51-83d5-cad4a6b9e953 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Image limits 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 18:00:45.652122 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-b7aba074-0676-4a51-83d5-cad4a6b9e953 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Flavor pref 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 18:00:45.652536 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-b7aba074-0676-4a51-83d5-cad4a6b9e953 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Image pref 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 18:00:45.652949 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-b7aba074-0676-4a51-83d5-cad4a6b9e953 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 18:00:45.662248 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b7aba074-0676-4a51-83d5-cad4a6b9e953 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:45.662696 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b7aba074-0676-4a51-83d5-cad4a6b9e953 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:45.663505 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b7aba074-0676-4a51-83d5-cad4a6b9e953 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:45.663995 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b7aba074-0676-4a51-83d5-cad4a6b9e953 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:45.681387 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.quota [None req-b7aba074-0676-4a51-83d5-cad4a6b9e953 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Getting quotas for project e51408d5653d460f82009b65e238281f. Resources: {'ram', 'cores', 'instances'} {{(pid=129471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 18:00:45.685349 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.quota [None req-b7aba074-0676-4a51-83d5-cad4a6b9e953 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Getting quotas for user 84c38f6ff5af4ba79c80fb581baacb0b and project e51408d5653d460f82009b65e238281f. Resources: {'ram', 'cores', 'instances'} {{(pid=129471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 18:00:45.697280 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-b7aba074-0676-4a51-83d5-cad4a6b9e953 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Going to run 1 instances... {{(pid=129471) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 18:00:45.699746 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-b7aba074-0676-4a51-83d5-cad4a6b9e953 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: c25aaf9b-059d-4605-8607-8810702e9ee7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf1f5d8c-9e49-4272-8e19-8e3c587056e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 18:00:45.745936 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-b7aba074-0676-4a51-83d5-cad4a6b9e953 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.877040 Jul 14 18:00:45.746813 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 466/883] 10.222.0.64 () {60 vars in 1146 bytes} [Thu Jul 14 18:00:44 2022] POST /compute/v2.1/servers => generated 400 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 18:00:45.756573 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-656acee3-f271-4c9d-a90c-670782f69af9 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:45.757184 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-656acee3-f271-4c9d-a90c-670782f69af9 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: c25aaf9b-059d-4605-8607-8810702e9ee7] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:45.812282 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-656acee3-f271-4c9d-a90c-670782f69af9 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:00:45.819152 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-656acee3-f271-4c9d-a90c-670782f69af9 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7" status: 200 len: 1236 microversion: 2.1 time: 0.066344 Jul 14 18:00:45.819721 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 418/884] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:45 2022] GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7 => generated 1236 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:00:46.656733 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-d50f46fd-a189-434f-b8e0-5758b568759f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:46.657887 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-d50f46fd-a189-434f-b8e0-5758b568759f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:46.671762 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d50f46fd-a189-434f-b8e0-5758b568759f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:46.672795 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d50f46fd-a189-434f-b8e0-5758b568759f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:46.673835 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d50f46fd-a189-434f-b8e0-5758b568759f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:46.674356 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d50f46fd-a189-434f-b8e0-5758b568759f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:46.677327 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-3b8a91d0-7bcf-4fcd-b756-4a6b7ae363d1 req-2a21b578-4be0-4e30-bdbd-653a3018f412 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8687636-908e-466b-b6dc-3a3e607debb1", "name": "network-vif-deleted", "tag": "6c1c53f4-2ce6-4875-9196-03a35b5f13c4"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:00:46.758883 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-d50f46fd-a189-434f-b8e0-5758b568759f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:00:46.769510 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-d50f46fd-a189-434f-b8e0-5758b568759f tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 200 len: 1465 microversion: 2.1 time: 0.118857 Jul 14 18:00:46.780122 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 467/885] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:46 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 1465 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 18:00:46.838280 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-7da2d7ba-06a9-44e9-ad27-8cd032220172 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:46.838951 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-7da2d7ba-06a9-44e9-ad27-8cd032220172 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: c25aaf9b-059d-4605-8607-8810702e9ee7] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:46.848521 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7da2d7ba-06a9-44e9-ad27-8cd032220172 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:46.848980 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7da2d7ba-06a9-44e9-ad27-8cd032220172 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:46.849922 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7da2d7ba-06a9-44e9-ad27-8cd032220172 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:46.850374 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7da2d7ba-06a9-44e9-ad27-8cd032220172 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:46.853072 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-3b8a91d0-7bcf-4fcd-b756-4a6b7ae363d1 req-2a21b578-4be0-4e30-bdbd-653a3018f412 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:46.853746 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-3b8a91d0-7bcf-4fcd-b756-4a6b7ae363d1 req-2a21b578-4be0-4e30-bdbd-653a3018f412 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:46.865863 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-3b8a91d0-7bcf-4fcd-b756-4a6b7ae363d1 req-2a21b578-4be0-4e30-bdbd-653a3018f412 service nova] Creating event network-vif-deleted:6c1c53f4-2ce6-4875-9196-03a35b5f13c4 for instance d8687636-908e-466b-b6dc-3a3e607debb1 on hv-cinder-84989 Jul 14 18:00:46.871092 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-3b8a91d0-7bcf-4fcd-b756-4a6b7ae363d1 req-2a21b578-4be0-4e30-bdbd-653a3018f412 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198059 Jul 14 18:00:46.872571 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 419/886] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:00:46.926644 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-7da2d7ba-06a9-44e9-ad27-8cd032220172 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:00:46.934593 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-7da2d7ba-06a9-44e9-ad27-8cd032220172 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7" status: 200 len: 1296 microversion: 2.1 time: 0.101750 Jul 14 18:00:46.935216 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 468/887] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:46 2022] GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7 => generated 1296 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 18:00:47.787562 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-45e0d5f3-c9aa-4bb2-a683-d266f9b5bcdf tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:47.788398 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-45e0d5f3-c9aa-4bb2-a683-d266f9b5bcdf tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: d8687636-908e-466b-b6dc-3a3e607debb1] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:47.794709 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-45e0d5f3-c9aa-4bb2-a683-d266f9b5bcdf tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:47.795234 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-45e0d5f3-c9aa-4bb2-a683-d266f9b5bcdf tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:47.796107 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-45e0d5f3-c9aa-4bb2-a683-d266f9b5bcdf tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:47.796630 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-45e0d5f3-c9aa-4bb2-a683-d266f9b5bcdf tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:47.810629 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.wsgi [None req-45e0d5f3-c9aa-4bb2-a683-d266f9b5bcdf tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] HTTP exception thrown: Instance d8687636-908e-466b-b6dc-3a3e607debb1 could not be found. Jul 14 18:00:47.812363 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-45e0d5f3-c9aa-4bb2-a683-d266f9b5bcdf tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Request method failure captured: Jul 14 18:00:47.812363 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: request: GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 HTTP/1.1 Jul 14 18:00:47.812363 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept: application/json Jul 14 18:00:47.812363 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept-Encoding: identity Jul 14 18:00:47.812363 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Connection: close Jul 14 18:00:47.812363 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Length: 0 Jul 14 18:00:47.812363 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Type: application/json Jul 14 18:00:47.812363 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Host: 10.222.0.64 Jul 14 18:00:47.812363 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Openstack-System-Scope: None Jul 14 18:00:47.812363 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: User-Agent: python-urllib3/1.26.9 Jul 14 18:00:47.812363 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Auth-Token: gAAAAABi0FfL6emn5hg2SNahQObVYYShIrtH-f3Fd-CAp1ihyP3qn1qpxmH7972vS_WzpDPVTAyMR2SXNmzXKBpQQN8nUKpUEX5KNrSOtzqNYhKbT7o6DhLBkpLmyAxCB9QiIEyoBCjGxn1ftlUyU7aDfEm3oaSulrngFZzD1cGUryIY_p8LWw4 Jul 14 18:00:47.812363 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Id: None Jul 14 18:00:47.812363 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Name: None Jul 14 18:00:47.812363 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Identity-Status: Confirmed Jul 14 18:00:47.812363 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Is-Admin-Project: True Jul 14 18:00:47.812363 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Id: default Jul 14 18:00:47.812363 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Name: Default Jul 14 18:00:47.812363 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Id: ab58d5c4c0194b58ad47dd5e4494389f Jul 14 18:00:47.812363 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-763337508 Jul 14 18:00:47.812363 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Role: reader,member Jul 14 18:00:47.812363 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Roles: reader,member Jul 14 18:00:47.813914 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ab58d5c4c0194b58ad47dd5e4494389f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ab58d5c4c0194b58ad47dd5e4494389f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ab58d5c4c0194b58ad47dd5e4494389f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ab58d5c4c0194b58ad47dd5e4494389f", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:00:47.813914 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant: tempest-ServerRescueNegativeTestJSON-763337508 Jul 14 18:00:47.813914 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Id: ab58d5c4c0194b58ad47dd5e4494389f Jul 14 18:00:47.813914 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-763337508 Jul 14 18:00:47.813914 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User: tempest-ServerRescueNegativeTestJSON-763337508-project Jul 14 18:00:47.813914 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Id: default Jul 14 18:00:47.813914 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Name: Default Jul 14 18:00:47.813914 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Id: 52c794c11ab74f9ca9bad75857043a62 Jul 14 18:00:47.813914 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Name: tempest-ServerRescueNegativeTestJSON-763337508-project Jul 14 18:00:47.813914 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: method: > Jul 14 18:00:47.813914 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: exception: Instance d8687636-908e-466b-b6dc-3a3e607debb1 could not be found. Jul 14 18:00:47.813914 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: action_args: {'id': 'd8687636-908e-466b-b6dc-3a3e607debb1'} Jul 14 18:00:47.814789 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:00:47.814789 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:00:47.814789 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 18:00:47.814789 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 18:00:47.814789 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 18:00:47.814789 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 18:00:47.814789 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 18:00:47.814789 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 18:00:47.814789 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 18:00:47.814789 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 18:00:47.814789 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8687636-908e-466b-b6dc-3a3e607debb1 could not be found. Jul 14 18:00:47.814789 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:00:47.814789 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:00:47.814789 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:00:47.814789 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:00:47.814789 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:00:47.814789 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:00:47.814789 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:00:47.814789 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:00:47.814789 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:00:47.816757 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:00:47.816757 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 18:00:47.816757 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 18:00:47.816757 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 18:00:47.816757 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 18:00:47.816757 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 18:00:47.816757 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 18:00:47.816757 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8687636-908e-466b-b6dc-3a3e607debb1 could not be found. Jul 14 18:00:47.816757 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:00:47.816757 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:00:47.816757 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:00:47.816757 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:00:47.816757 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:00:47.816757 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:00:47.816757 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 18:00:47.816757 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 18:00:47.816757 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8687636-908e-466b-b6dc-3a3e607debb1 could not be found. Jul 14 18:00:47.816757 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:00:47.819334 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-45e0d5f3-c9aa-4bb2-a683-d266f9b5bcdf tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Returning 404 to user: Instance d8687636-908e-466b-b6dc-3a3e607debb1 could not be found. {{(pid=129470) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:00:47.820194 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-45e0d5f3-c9aa-4bb2-a683-d266f9b5bcdf tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1" status: 404 len: 111 microversion: 2.1 time: 0.037297 Jul 14 18:00:47.820758 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 420/888] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:47 2022] GET /compute/v2.1/servers/d8687636-908e-466b-b6dc-3a3e607debb1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 18:00:47.829849 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-3812381b-3aee-4f50-9f4d-ad6894dc5153 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:47.830384 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-3812381b-3aee-4f50-9f4d-ad6894dc5153 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:47.836878 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3812381b-3aee-4f50-9f4d-ad6894dc5153 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:47.837337 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3812381b-3aee-4f50-9f4d-ad6894dc5153 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:47.838119 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3812381b-3aee-4f50-9f4d-ad6894dc5153 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:47.838563 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3812381b-3aee-4f50-9f4d-ad6894dc5153 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:47.864801 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-3812381b-3aee-4f50-9f4d-ad6894dc5153 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Going to try to terminate instance {{(pid=129471) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 18:00:47.901040 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:00:47.947554 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-3812381b-3aee-4f50-9f4d-ad6894dc5153 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "DELETE /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 204 len: 0 microversion: 2.1 time: 0.121325 Jul 14 18:00:47.952001 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 469/889] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Jul 14 18:00:47 2022] DELETE /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 18:00:47.954214 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-2f309e58-4f52-44d2-9809-b49ad03b50c3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:47.954959 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-2f309e58-4f52-44d2-9809-b49ad03b50c3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: c25aaf9b-059d-4605-8607-8810702e9ee7] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:47.959316 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-97794ef8-1703-4669-90fc-c5d2513238c3 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:47.960094 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-97794ef8-1703-4669-90fc-c5d2513238c3 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:47.962755 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2f309e58-4f52-44d2-9809-b49ad03b50c3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:47.963231 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2f309e58-4f52-44d2-9809-b49ad03b50c3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:47.964256 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2f309e58-4f52-44d2-9809-b49ad03b50c3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:47.964689 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2f309e58-4f52-44d2-9809-b49ad03b50c3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:47.966972 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-97794ef8-1703-4669-90fc-c5d2513238c3 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:47.967592 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-97794ef8-1703-4669-90fc-c5d2513238c3 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:47.968408 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-97794ef8-1703-4669-90fc-c5d2513238c3 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:47.969016 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-97794ef8-1703-4669-90fc-c5d2513238c3 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:48.186561 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-97794ef8-1703-4669-90fc-c5d2513238c3 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:00:48.195114 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-97794ef8-1703-4669-90fc-c5d2513238c3 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1521 microversion: 2.1 time: 0.240962 Jul 14 18:00:48.204667 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 470/890] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:47 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 18:00:48.205075 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-2f309e58-4f52-44d2-9809-b49ad03b50c3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:00:48.205191 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-996b0035-5b4a-4a16-8e0d-75b839412c62 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1322227927"}} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:00:48.205191 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-996b0035-5b4a-4a16-8e0d-75b839412c62 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:48.206415 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-2f309e58-4f52-44d2-9809-b49ad03b50c3 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7" status: 200 len: 1360 microversion: 2.1 time: 0.256674 Jul 14 18:00:48.206678 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-996b0035-5b4a-4a16-8e0d-75b839412c62 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:48.207124 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-996b0035-5b4a-4a16-8e0d-75b839412c62 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:48.207889 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-996b0035-5b4a-4a16-8e0d-75b839412c62 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:48.208350 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-996b0035-5b4a-4a16-8e0d-75b839412c62 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:48.214747 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 421/891] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:47 2022] GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7 => generated 1360 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 18:00:48.336130 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.network.security_group_api [None req-996b0035-5b4a-4a16-8e0d-75b839412c62 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Removing security group 4b41a172-4b31-4318-9116-438a3ed33cf0 from port e4104856-b157-4b68-bc78-cbaf334757bd Jul 14 18:00:48.700295 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-996b0035-5b4a-4a16-8e0d-75b839412c62 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "POST /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19/action" status: 202 len: 0 microversion: 2.1 time: 0.503478 Jul 14 18:00:48.700917 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 471/892] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Jul 14 18:00:48 2022] POST /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19/action => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 18:00:48.715331 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-6644d31a-92f0-4b15-bf87-1200e452882c req-852a9158-4cf7-4d57-a318-ad1565213916 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06993daa-d7b7-4496-b60f-71da361f1c19", "tag": "e4104856-b157-4b68-bc78-cbaf334757bd"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:00:48.723476 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-6644d31a-92f0-4b15-bf87-1200e452882c req-852a9158-4cf7-4d57-a318-ad1565213916 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:48.724161 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-6644d31a-92f0-4b15-bf87-1200e452882c req-852a9158-4cf7-4d57-a318-ad1565213916 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:48.746605 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-6644d31a-92f0-4b15-bf87-1200e452882c req-852a9158-4cf7-4d57-a318-ad1565213916 service nova] Creating event network-changed:e4104856-b157-4b68-bc78-cbaf334757bd for instance 06993daa-d7b7-4496-b60f-71da361f1c19 on hv-cinder-84989 Jul 14 18:00:48.758560 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-6644d31a-92f0-4b15-bf87-1200e452882c req-852a9158-4cf7-4d57-a318-ad1565213916 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047291 Jul 14 18:00:48.761101 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 422/893] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:00:49.215064 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-7ec0d494-5cc8-46c4-9895-8c987aec44bc tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:49.216521 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-7ec0d494-5cc8-46c4-9895-8c987aec44bc tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:49.223578 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-a9e12f06-6a9f-4fc1-9f7c-e8274533c815 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:49.226069 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-a9e12f06-6a9f-4fc1-9f7c-e8274533c815 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: c25aaf9b-059d-4605-8607-8810702e9ee7] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:49.243952 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7ec0d494-5cc8-46c4-9895-8c987aec44bc tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:49.245454 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a9e12f06-6a9f-4fc1-9f7c-e8274533c815 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:49.246201 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7ec0d494-5cc8-46c4-9895-8c987aec44bc tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:49.248296 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a9e12f06-6a9f-4fc1-9f7c-e8274533c815 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:49.253358 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7ec0d494-5cc8-46c4-9895-8c987aec44bc tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:49.253925 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a9e12f06-6a9f-4fc1-9f7c-e8274533c815 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:49.254789 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7ec0d494-5cc8-46c4-9895-8c987aec44bc tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:49.255558 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a9e12f06-6a9f-4fc1-9f7c-e8274533c815 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:49.532069 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-a9e12f06-6a9f-4fc1-9f7c-e8274533c815 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:00:49.539948 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-a9e12f06-6a9f-4fc1-9f7c-e8274533c815 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7" status: 200 len: 1360 microversion: 2.1 time: 0.321049 Jul 14 18:00:49.541777 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 423/894] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:49 2022] GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7 => generated 1360 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:00:49.713487 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-7ec0d494-5cc8-46c4-9895-8c987aec44bc tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:00:49.724917 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-7ec0d494-5cc8-46c4-9895-8c987aec44bc tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1521 microversion: 2.1 time: 0.516268 Jul 14 18:00:49.726165 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 472/895] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:49 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1521 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:00:49.986373 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-37213500-9f1b-4377-8f70-138fd9235835 req-dd1e7768-74d7-4d48-8d52-c7452653212f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c25aaf9b-059d-4605-8607-8810702e9ee7", "tag": "55ac38e4-f540-4ccf-a87b-fa51764aa743"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:00:50.010126 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-37213500-9f1b-4377-8f70-138fd9235835 req-dd1e7768-74d7-4d48-8d52-c7452653212f service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:50.010581 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-37213500-9f1b-4377-8f70-138fd9235835 req-dd1e7768-74d7-4d48-8d52-c7452653212f service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:50.038118 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-37213500-9f1b-4377-8f70-138fd9235835 req-dd1e7768-74d7-4d48-8d52-c7452653212f service nova] Creating event network-changed:55ac38e4-f540-4ccf-a87b-fa51764aa743 for instance c25aaf9b-059d-4605-8607-8810702e9ee7 on hv-cinder-84989 Jul 14 18:00:50.052756 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-37213500-9f1b-4377-8f70-138fd9235835 req-dd1e7768-74d7-4d48-8d52-c7452653212f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068401 Jul 14 18:00:50.054070 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 424/896] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:00:50.385637 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-4101af09-90c4-4e39-97a1-e702456f2822 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:50.386196 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-4101af09-90c4-4e39-97a1-e702456f2822 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:50.397909 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4101af09-90c4-4e39-97a1-e702456f2822 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:50.402503 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4101af09-90c4-4e39-97a1-e702456f2822 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:50.403699 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4101af09-90c4-4e39-97a1-e702456f2822 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:50.404264 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4101af09-90c4-4e39-97a1-e702456f2822 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:50.503295 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.objects.instance [None req-4101af09-90c4-4e39-97a1-e702456f2822 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lazy-loading 'services' on Instance uuid 06993daa-d7b7-4496-b60f-71da361f1c19 {{(pid=129471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 18:00:50.558735 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-aeb2bc84-cc36-490d-9469-490164a4611d tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:50.559558 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-aeb2bc84-cc36-490d-9469-490164a4611d tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: c25aaf9b-059d-4605-8607-8810702e9ee7] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:50.568305 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-aeb2bc84-cc36-490d-9469-490164a4611d tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:50.572952 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-aeb2bc84-cc36-490d-9469-490164a4611d tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:50.573863 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-aeb2bc84-cc36-490d-9469-490164a4611d tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:50.574393 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-aeb2bc84-cc36-490d-9469-490164a4611d tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:50.602615 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-4101af09-90c4-4e39-97a1-e702456f2822 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "DELETE /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19/os-volume_attachments/dfe31ed8-944f-4c90-b6ce-3d14e5487d47" status: 202 len: 0 microversion: 2.1 time: 0.221708 Jul 14 18:00:50.603510 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 473/897] 10.222.0.64 () {58 vars in 1415 bytes} [Thu Jul 14 18:00:50 2022] DELETE /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19/os-volume_attachments/dfe31ed8-944f-4c90-b6ce-3d14e5487d47 => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 18:00:50.613194 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-2287eeb3-8086-49fd-be25-0cdd17165ffc tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:50.614683 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-2287eeb3-8086-49fd-be25-0cdd17165ffc tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:50.632438 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2287eeb3-8086-49fd-be25-0cdd17165ffc tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:50.636055 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2287eeb3-8086-49fd-be25-0cdd17165ffc tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:50.640262 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2287eeb3-8086-49fd-be25-0cdd17165ffc tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:50.641002 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2287eeb3-8086-49fd-be25-0cdd17165ffc tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:50.703184 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-2287eeb3-8086-49fd-be25-0cdd17165ffc tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094542 Jul 14 18:00:50.703770 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 474/898] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Jul 14 18:00:50 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 18:00:50.744414 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-dcde485a-e78f-4598-b781-b0091040ca11 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:50.745412 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-dcde485a-e78f-4598-b781-b0091040ca11 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:50.760597 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-dcde485a-e78f-4598-b781-b0091040ca11 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:50.761512 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-dcde485a-e78f-4598-b781-b0091040ca11 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:50.762525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-dcde485a-e78f-4598-b781-b0091040ca11 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:50.763673 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-dcde485a-e78f-4598-b781-b0091040ca11 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:50.783185 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-aeb2bc84-cc36-490d-9469-490164a4611d tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:00:50.793646 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-aeb2bc84-cc36-490d-9469-490164a4611d tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7" status: 200 len: 1360 microversion: 2.1 time: 0.240247 Jul 14 18:00:50.795727 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 425/899] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:50 2022] GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7 => generated 1360 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:00:50.807310 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-52f5b09a-8b5f-4270-b073-eac38c7c66a1 req-df8f6b30-a384-4608-bbe5-73c7f8e8132e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06993daa-d7b7-4496-b60f-71da361f1c19", "tag": "e4104856-b157-4b68-bc78-cbaf334757bd"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:00:50.810082 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-dcde485a-e78f-4598-b781-b0091040ca11 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:50.810536 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-dcde485a-e78f-4598-b781-b0091040ca11 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:50.811404 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.objects.instance [None req-dcde485a-e78f-4598-b781-b0091040ca11 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lazy-loading 'fault' on Instance uuid 323310aa-bd8a-4a21-9733-b1e73763a250 {{(pid=129471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 18:00:50.827299 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-52f5b09a-8b5f-4270-b073-eac38c7c66a1 req-df8f6b30-a384-4608-bbe5-73c7f8e8132e service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:50.828074 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-52f5b09a-8b5f-4270-b073-eac38c7c66a1 req-df8f6b30-a384-4608-bbe5-73c7f8e8132e service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:50.843270 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-52f5b09a-8b5f-4270-b073-eac38c7c66a1 req-df8f6b30-a384-4608-bbe5-73c7f8e8132e service nova] Creating event network-changed:e4104856-b157-4b68-bc78-cbaf334757bd for instance 06993daa-d7b7-4496-b60f-71da361f1c19 on hv-cinder-84989 Jul 14 18:00:50.849715 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-52f5b09a-8b5f-4270-b073-eac38c7c66a1 req-df8f6b30-a384-4608-bbe5-73c7f8e8132e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052236 Jul 14 18:00:50.850580 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 426/900] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:00:50.869237 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-dcde485a-e78f-4598-b781-b0091040ca11 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c794c11ab74f9ca9bad75857043a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab58d5c4c0194b58ad47dd5e4494389f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:00:50.876435 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-dcde485a-e78f-4598-b781-b0091040ca11 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 200 len: 1311 microversion: 2.1 time: 0.137234 Jul 14 18:00:50.877396 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 475/901] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:50 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 1311 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:00:51.716464 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-126f0bff-7700-419c-953b-3e4bf40def70 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:51.717508 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-126f0bff-7700-419c-953b-3e4bf40def70 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:51.724193 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-126f0bff-7700-419c-953b-3e4bf40def70 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:51.724650 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-126f0bff-7700-419c-953b-3e4bf40def70 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:51.725414 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-126f0bff-7700-419c-953b-3e4bf40def70 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:51.725853 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-126f0bff-7700-419c-953b-3e4bf40def70 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:51.755462 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-126f0bff-7700-419c-953b-3e4bf40def70 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043860 Jul 14 18:00:51.756033 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 427/902] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Jul 14 18:00:51 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:00:51.812698 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-3c9957df-2485-451a-a8a9-be6e5b9bfd9c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:51.813730 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-3c9957df-2485-451a-a8a9-be6e5b9bfd9c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: c25aaf9b-059d-4605-8607-8810702e9ee7] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:51.820791 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3c9957df-2485-451a-a8a9-be6e5b9bfd9c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:51.821252 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3c9957df-2485-451a-a8a9-be6e5b9bfd9c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:51.822028 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3c9957df-2485-451a-a8a9-be6e5b9bfd9c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:51.822469 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3c9957df-2485-451a-a8a9-be6e5b9bfd9c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:51.894326 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-02b08032-afc5-42d1-b5de-1290944b4c38 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:51.895039 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-02b08032-afc5-42d1-b5de-1290944b4c38 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] [instance: 323310aa-bd8a-4a21-9733-b1e73763a250] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:51.902182 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-02b08032-afc5-42d1-b5de-1290944b4c38 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:51.902637 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-02b08032-afc5-42d1-b5de-1290944b4c38 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:51.903423 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-02b08032-afc5-42d1-b5de-1290944b4c38 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:51.903865 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-02b08032-afc5-42d1-b5de-1290944b4c38 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:51.919216 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.wsgi [None req-02b08032-afc5-42d1-b5de-1290944b4c38 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] HTTP exception thrown: Instance 323310aa-bd8a-4a21-9733-b1e73763a250 could not be found. Jul 14 18:00:51.920929 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-02b08032-afc5-42d1-b5de-1290944b4c38 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Request method failure captured: Jul 14 18:00:51.920929 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: request: GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 HTTP/1.1 Jul 14 18:00:51.920929 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept: application/json Jul 14 18:00:51.920929 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept-Encoding: identity Jul 14 18:00:51.920929 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Connection: close Jul 14 18:00:51.920929 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Length: 0 Jul 14 18:00:51.920929 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Type: application/json Jul 14 18:00:51.920929 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Host: 10.222.0.64 Jul 14 18:00:51.920929 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Openstack-System-Scope: None Jul 14 18:00:51.920929 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: User-Agent: python-urllib3/1.26.9 Jul 14 18:00:51.920929 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Auth-Token: gAAAAABi0FfL6emn5hg2SNahQObVYYShIrtH-f3Fd-CAp1ihyP3qn1qpxmH7972vS_WzpDPVTAyMR2SXNmzXKBpQQN8nUKpUEX5KNrSOtzqNYhKbT7o6DhLBkpLmyAxCB9QiIEyoBCjGxn1ftlUyU7aDfEm3oaSulrngFZzD1cGUryIY_p8LWw4 Jul 14 18:00:51.920929 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Id: None Jul 14 18:00:51.920929 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Name: None Jul 14 18:00:51.920929 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Identity-Status: Confirmed Jul 14 18:00:51.920929 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Is-Admin-Project: True Jul 14 18:00:51.920929 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Id: default Jul 14 18:00:51.920929 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Name: Default Jul 14 18:00:51.920929 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Id: ab58d5c4c0194b58ad47dd5e4494389f Jul 14 18:00:51.920929 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-763337508 Jul 14 18:00:51.920929 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Role: reader,member Jul 14 18:00:51.920929 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Roles: reader,member Jul 14 18:00:51.922602 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ab58d5c4c0194b58ad47dd5e4494389f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ab58d5c4c0194b58ad47dd5e4494389f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ab58d5c4c0194b58ad47dd5e4494389f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ab58d5c4c0194b58ad47dd5e4494389f", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:00:51.922602 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant: tempest-ServerRescueNegativeTestJSON-763337508 Jul 14 18:00:51.922602 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Id: ab58d5c4c0194b58ad47dd5e4494389f Jul 14 18:00:51.922602 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-763337508 Jul 14 18:00:51.922602 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User: tempest-ServerRescueNegativeTestJSON-763337508-project Jul 14 18:00:51.922602 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Id: default Jul 14 18:00:51.922602 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Name: Default Jul 14 18:00:51.922602 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Id: 52c794c11ab74f9ca9bad75857043a62 Jul 14 18:00:51.922602 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Name: tempest-ServerRescueNegativeTestJSON-763337508-project Jul 14 18:00:51.922602 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: method: > Jul 14 18:00:51.922602 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: exception: Instance 323310aa-bd8a-4a21-9733-b1e73763a250 could not be found. Jul 14 18:00:51.922602 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: action_args: {'id': '323310aa-bd8a-4a21-9733-b1e73763a250'} Jul 14 18:00:51.923508 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:00:51.923508 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:00:51.923508 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 18:00:51.923508 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 18:00:51.923508 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 18:00:51.923508 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 18:00:51.923508 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 18:00:51.923508 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 18:00:51.923508 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 18:00:51.923508 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 18:00:51.923508 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 323310aa-bd8a-4a21-9733-b1e73763a250 could not be found. Jul 14 18:00:51.923508 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:00:51.923508 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:00:51.923508 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:00:51.923508 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:00:51.923508 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:00:51.923508 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:00:51.923508 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:00:51.923508 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:00:51.923508 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:00:51.925080 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:00:51.925080 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 18:00:51.925080 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 18:00:51.925080 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 18:00:51.925080 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 18:00:51.925080 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 18:00:51.925080 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 18:00:51.925080 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 323310aa-bd8a-4a21-9733-b1e73763a250 could not be found. Jul 14 18:00:51.925080 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:00:51.925080 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:00:51.925080 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:00:51.925080 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:00:51.925080 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:00:51.925080 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:00:51.925080 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 18:00:51.925080 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 18:00:51.925080 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 323310aa-bd8a-4a21-9733-b1e73763a250 could not be found. Jul 14 18:00:51.925080 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:00:51.926705 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-02b08032-afc5-42d1-b5de-1290944b4c38 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] Returning 404 to user: Instance 323310aa-bd8a-4a21-9733-b1e73763a250 could not be found. {{(pid=129470) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:00:51.926705 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-02b08032-afc5-42d1-b5de-1290944b4c38 tempest-ServerRescueNegativeTestJSON-763337508 tempest-ServerRescueNegativeTestJSON-763337508-project] 10.222.0.64 "GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250" status: 404 len: 111 microversion: 2.1 time: 0.031964 Jul 14 18:00:51.926705 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 428/903] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:51 2022] GET /compute/v2.1/servers/323310aa-bd8a-4a21-9733-b1e73763a250 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 18:00:51.964471 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-3c9957df-2485-451a-a8a9-be6e5b9bfd9c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:00:51.972414 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-3c9957df-2485-451a-a8a9-be6e5b9bfd9c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7" status: 200 len: 1360 microversion: 2.1 time: 0.164084 Jul 14 18:00:51.972993 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 476/904] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:51 2022] GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7 => generated 1360 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:00:52.108726 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-d2b566fb-7d3e-4322-b4c5-b2354ed7ebd6 req-2dd214fe-7dae-4187-92e6-602cabe88cf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "323310aa-bd8a-4a21-9733-b1e73763a250", "name": "network-vif-deleted", "tag": "bd30db4c-5dd9-4b56-9285-67801da2e116"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:00:52.116861 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-d2b566fb-7d3e-4322-b4c5-b2354ed7ebd6 req-2dd214fe-7dae-4187-92e6-602cabe88cf5 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:52.117305 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-d2b566fb-7d3e-4322-b4c5-b2354ed7ebd6 req-2dd214fe-7dae-4187-92e6-602cabe88cf5 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:52.128776 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-d2b566fb-7d3e-4322-b4c5-b2354ed7ebd6 req-2dd214fe-7dae-4187-92e6-602cabe88cf5 service nova] Creating event network-vif-deleted:bd30db4c-5dd9-4b56-9285-67801da2e116 for instance 323310aa-bd8a-4a21-9733-b1e73763a250 on hv-cinder-84989 Jul 14 18:00:52.134106 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-d2b566fb-7d3e-4322-b4c5-b2354ed7ebd6 req-2dd214fe-7dae-4187-92e6-602cabe88cf5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028521 Jul 14 18:00:52.134864 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 429/905] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:00:52.767117 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-9f3e4699-78da-425d-b7ea-1899e568d245 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:52.768145 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-9f3e4699-78da-425d-b7ea-1899e568d245 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:52.774440 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9f3e4699-78da-425d-b7ea-1899e568d245 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:52.774890 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9f3e4699-78da-425d-b7ea-1899e568d245 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:52.775667 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9f3e4699-78da-425d-b7ea-1899e568d245 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:52.776140 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9f3e4699-78da-425d-b7ea-1899e568d245 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:52.805165 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-9f3e4699-78da-425d-b7ea-1899e568d245 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041461 Jul 14 18:00:52.805741 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 477/906] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Jul 14 18:00:52 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:00:52.991036 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-7acab402-ff77-4c1f-bc4c-589072a5eeb6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:52.991724 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-7acab402-ff77-4c1f-bc4c-589072a5eeb6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: c25aaf9b-059d-4605-8607-8810702e9ee7] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:52.998407 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7acab402-ff77-4c1f-bc4c-589072a5eeb6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:52.998855 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7acab402-ff77-4c1f-bc4c-589072a5eeb6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:52.999660 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7acab402-ff77-4c1f-bc4c-589072a5eeb6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:53.000088 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7acab402-ff77-4c1f-bc4c-589072a5eeb6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:53.131911 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-7acab402-ff77-4c1f-bc4c-589072a5eeb6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:00:53.139642 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-7acab402-ff77-4c1f-bc4c-589072a5eeb6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7" status: 200 len: 1360 microversion: 2.1 time: 0.153330 Jul 14 18:00:53.140274 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 430/907] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:52 2022] GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7 => generated 1360 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:00:53.817043 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-0fab6466-00a2-47e2-a963-3ca1a307f685 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:53.818613 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-0fab6466-00a2-47e2-a963-3ca1a307f685 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:53.825897 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0fab6466-00a2-47e2-a963-3ca1a307f685 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:53.826342 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0fab6466-00a2-47e2-a963-3ca1a307f685 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:53.827441 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0fab6466-00a2-47e2-a963-3ca1a307f685 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:53.827874 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0fab6466-00a2-47e2-a963-3ca1a307f685 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:53.860765 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-0fab6466-00a2-47e2-a963-3ca1a307f685 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047774 Jul 14 18:00:53.861453 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 478/908] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Jul 14 18:00:53 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:00:54.156624 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-e31fac34-5d59-4227-b8ef-293ca1e2278f tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:54.157235 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-e31fac34-5d59-4227-b8ef-293ca1e2278f tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: c25aaf9b-059d-4605-8607-8810702e9ee7] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:54.164656 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e31fac34-5d59-4227-b8ef-293ca1e2278f tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:54.165347 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e31fac34-5d59-4227-b8ef-293ca1e2278f tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:54.166290 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e31fac34-5d59-4227-b8ef-293ca1e2278f tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:54.166885 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e31fac34-5d59-4227-b8ef-293ca1e2278f tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:54.326254 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-e31fac34-5d59-4227-b8ef-293ca1e2278f tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:00:54.340322 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-e31fac34-5d59-4227-b8ef-293ca1e2278f tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7" status: 200 len: 1360 microversion: 2.1 time: 0.187285 Jul 14 18:00:54.341188 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 431/909] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:54 2022] GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7 => generated 1360 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:00:54.873709 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-6a7dc680-4482-47b5-b8ca-6fd992a905c4 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:54.875054 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-6a7dc680-4482-47b5-b8ca-6fd992a905c4 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:54.887824 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6a7dc680-4482-47b5-b8ca-6fd992a905c4 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:54.888307 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6a7dc680-4482-47b5-b8ca-6fd992a905c4 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:54.889096 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6a7dc680-4482-47b5-b8ca-6fd992a905c4 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:54.889534 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6a7dc680-4482-47b5-b8ca-6fd992a905c4 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:54.924304 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-6a7dc680-4482-47b5-b8ca-6fd992a905c4 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054863 Jul 14 18:00:54.926029 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 479/910] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Jul 14 18:00:54 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 18:00:54.935642 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-55c1556d-22d0-4ce3-9e07-a24c4e24ea8a tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:54.936447 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-55c1556d-22d0-4ce3-9e07-a24c4e24ea8a tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:54.943845 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-55c1556d-22d0-4ce3-9e07-a24c4e24ea8a tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:54.944439 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-55c1556d-22d0-4ce3-9e07-a24c4e24ea8a tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:54.945712 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-55c1556d-22d0-4ce3-9e07-a24c4e24ea8a tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:54.946252 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-55c1556d-22d0-4ce3-9e07-a24c4e24ea8a tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:55.032355 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.wsgi [None req-55c1556d-22d0-4ce3-9e07-a24c4e24ea8a tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] HTTP exception thrown: Instance 06993daa-d7b7-4496-b60f-71da361f1c19 is not attached to volume dfe31ed8-944f-4c90-b6ce-3d14e5487d47 Jul 14 18:00:55.044359 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-55c1556d-22d0-4ce3-9e07-a24c4e24ea8a tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Request method failure captured: Jul 14 18:00:55.044359 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: request: DELETE /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19/os-volume_attachments/dfe31ed8-944f-4c90-b6ce-3d14e5487d47 HTTP/1.1 Jul 14 18:00:55.044359 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept: application/json Jul 14 18:00:55.044359 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept-Encoding: identity Jul 14 18:00:55.044359 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Connection: close Jul 14 18:00:55.044359 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Length: 0 Jul 14 18:00:55.044359 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Type: application/json Jul 14 18:00:55.044359 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Host: 10.222.0.64 Jul 14 18:00:55.044359 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Openstack-System-Scope: None Jul 14 18:00:55.044359 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: User-Agent: python-urllib3/1.26.9 Jul 14 18:00:55.044359 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Auth-Token: gAAAAABi0FijIqMyDbDD1y9ldj26RxbKDE-BVI8QeM8tgwWPH94uXusIFGaEhoWz0D6R8AGiSS3Bimr5jvbbwJTMUo7uMmRk76Ph8u4RJnJpTiobUgjR5yL9LTgCN1lkWagmua9nrfaWz0IV59b-pYBy9EEKM92ez0NxA8gn_i3aPSH6yoO0IxQ Jul 14 18:00:55.044359 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Id: None Jul 14 18:00:55.044359 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Name: None Jul 14 18:00:55.044359 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Identity-Status: Confirmed Jul 14 18:00:55.044359 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Is-Admin-Project: True Jul 14 18:00:55.044359 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Id: default Jul 14 18:00:55.044359 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Name: Default Jul 14 18:00:55.044359 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Id: fa36825e7c014d48a7fe9375d9abdf7d Jul 14 18:00:55.044359 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Name: tempest-TestMinimumBasicScenario-436091456 Jul 14 18:00:55.044359 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Role: reader,member Jul 14 18:00:55.044359 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Roles: reader,member Jul 14 18:00:55.047493 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fa36825e7c014d48a7fe9375d9abdf7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/fa36825e7c014d48a7fe9375d9abdf7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fa36825e7c014d48a7fe9375d9abdf7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_fa36825e7c014d48a7fe9375d9abdf7d", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:00:55.047493 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant: tempest-TestMinimumBasicScenario-436091456 Jul 14 18:00:55.047493 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Id: fa36825e7c014d48a7fe9375d9abdf7d Jul 14 18:00:55.047493 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Name: tempest-TestMinimumBasicScenario-436091456 Jul 14 18:00:55.047493 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User: tempest-TestMinimumBasicScenario-436091456-project Jul 14 18:00:55.047493 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Id: default Jul 14 18:00:55.047493 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Name: Default Jul 14 18:00:55.047493 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Id: 3e3fd98743554b0a8bf1cea0523ed4ae Jul 14 18:00:55.047493 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Name: tempest-TestMinimumBasicScenario-436091456-project Jul 14 18:00:55.047493 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: method: > Jul 14 18:00:55.047493 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: exception: Instance 06993daa-d7b7-4496-b60f-71da361f1c19 is not attached to volume dfe31ed8-944f-4c90-b6ce-3d14e5487d47 Jul 14 18:00:55.048729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: action_args: {'server_id': '06993daa-d7b7-4496-b60f-71da361f1c19', 'id': 'dfe31ed8-944f-4c90-b6ce-3d14e5487d47'} Jul 14 18:00:55.048729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:00:55.048729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:00:55.048729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 14 18:00:55.048729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 14 18:00:55.048729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 18:00:55.048729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 18:00:55.048729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 14 18:00:55.048729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 14 18:00:55.048729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id dfe31ed8-944f-4c90-b6ce-3d14e5487d47. Jul 14 18:00:55.048729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:00:55.048729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:00:55.048729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:00:55.048729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:00:55.048729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:00:55.048729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:00:55.048729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:00:55.048729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:00:55.048729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:00:55.050244 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:00:55.050244 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 14 18:00:55.050244 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 14 18:00:55.050244 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06993daa-d7b7-4496-b60f-71da361f1c19 is not attached to volume dfe31ed8-944f-4c90-b6ce-3d14e5487d47 Jul 14 18:00:55.050244 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:00:55.050244 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:00:55.050244 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:00:55.050244 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:00:55.050244 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:00:55.050244 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:00:55.050244 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 18:00:55.050244 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 18:00:55.050244 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06993daa-d7b7-4496-b60f-71da361f1c19 is not attached to volume dfe31ed8-944f-4c90-b6ce-3d14e5487d47 Jul 14 18:00:55.050244 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:00:55.053448 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-55c1556d-22d0-4ce3-9e07-a24c4e24ea8a tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Returning 404 to user: Instance 06993daa-d7b7-4496-b60f-71da361f1c19 is not attached to volume dfe31ed8-944f-4c90-b6ce-3d14e5487d47 {{(pid=129470) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:00:55.054952 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-55c1556d-22d0-4ce3-9e07-a24c4e24ea8a tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "DELETE /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19/os-volume_attachments/dfe31ed8-944f-4c90-b6ce-3d14e5487d47" status: 404 len: 154 microversion: 2.1 time: 0.123452 Jul 14 18:00:55.056027 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 432/911] 10.222.0.64 () {58 vars in 1415 bytes} [Thu Jul 14 18:00:54 2022] DELETE /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19/os-volume_attachments/dfe31ed8-944f-4c90-b6ce-3d14e5487d47 => generated 154 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 18:00:55.359207 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-85d87a72-d7ba-4764-ab0b-69cb38e0d113 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:55.360424 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-85d87a72-d7ba-4764-ab0b-69cb38e0d113 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: c25aaf9b-059d-4605-8607-8810702e9ee7] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:55.368584 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-85d87a72-d7ba-4764-ab0b-69cb38e0d113 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:55.369503 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-85d87a72-d7ba-4764-ab0b-69cb38e0d113 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:55.370477 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-85d87a72-d7ba-4764-ab0b-69cb38e0d113 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:55.371080 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-85d87a72-d7ba-4764-ab0b-69cb38e0d113 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:55.672360 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell0:SELECT=2 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:00:55.693602 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell0:SELECT=6 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:00:55.703210 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-85d87a72-d7ba-4764-ab0b-69cb38e0d113 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:00:55.715308 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-85d87a72-d7ba-4764-ab0b-69cb38e0d113 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7" status: 200 len: 1360 microversion: 2.1 time: 0.361265 Jul 14 18:00:55.716352 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 480/912] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:55 2022] GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7 => generated 1360 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:00:56.298981 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-f53d9636-de79-45fb-bad5-4d4bbbaa06ec tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:56.299533 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-f53d9636-de79-45fb-bad5-4d4bbbaa06ec tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:56.304223 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell0:SELECT=6 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:00:56.308907 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f53d9636-de79-45fb-bad5-4d4bbbaa06ec tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:56.309359 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f53d9636-de79-45fb-bad5-4d4bbbaa06ec tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:56.310163 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f53d9636-de79-45fb-bad5-4d4bbbaa06ec tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:56.310770 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f53d9636-de79-45fb-bad5-4d4bbbaa06ec tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:56.339708 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-f53d9636-de79-45fb-bad5-4d4bbbaa06ec tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Going to try to terminate instance {{(pid=129470) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 18:00:56.426506 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-f53d9636-de79-45fb-bad5-4d4bbbaa06ec tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "DELETE /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 204 len: 0 microversion: 2.1 time: 0.130750 Jul 14 18:00:56.427573 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 433/913] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Jul 14 18:00:56 2022] DELETE /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 18:00:56.437324 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-88680c25-f8d8-4d02-b645-00bbdcd97dbd tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:56.438034 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-88680c25-f8d8-4d02-b645-00bbdcd97dbd tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:56.444957 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-88680c25-f8d8-4d02-b645-00bbdcd97dbd tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:56.445546 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-88680c25-f8d8-4d02-b645-00bbdcd97dbd tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:56.446428 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-88680c25-f8d8-4d02-b645-00bbdcd97dbd tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:56.446956 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-88680c25-f8d8-4d02-b645-00bbdcd97dbd tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:56.593884 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-88680c25-f8d8-4d02-b645-00bbdcd97dbd tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:00:56.602309 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-88680c25-f8d8-4d02-b645-00bbdcd97dbd tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1554 microversion: 2.1 time: 0.169430 Jul 14 18:00:56.602894 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 481/914] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:56 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:00:56.732257 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-95c0b02b-f09d-4a47-88d8-e43fc23e9644 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:56.733339 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-95c0b02b-f09d-4a47-88d8-e43fc23e9644 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: c25aaf9b-059d-4605-8607-8810702e9ee7] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:56.736393 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:00:56.740847 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-95c0b02b-f09d-4a47-88d8-e43fc23e9644 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:56.741550 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-95c0b02b-f09d-4a47-88d8-e43fc23e9644 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:56.742341 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-95c0b02b-f09d-4a47-88d8-e43fc23e9644 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:56.742955 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-95c0b02b-f09d-4a47-88d8-e43fc23e9644 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:56.890942 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-95c0b02b-f09d-4a47-88d8-e43fc23e9644 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:00:56.899129 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-95c0b02b-f09d-4a47-88d8-e43fc23e9644 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7" status: 200 len: 1360 microversion: 2.1 time: 0.171314 Jul 14 18:00:56.899826 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 434/915] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:56 2022] GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7 => generated 1360 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:00:57.620600 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-2193e5d3-b5b0-4245-a8aa-46d6d156e328 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:57.621340 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-2193e5d3-b5b0-4245-a8aa-46d6d156e328 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:57.627795 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2193e5d3-b5b0-4245-a8aa-46d6d156e328 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:57.628280 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2193e5d3-b5b0-4245-a8aa-46d6d156e328 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:57.629058 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2193e5d3-b5b0-4245-a8aa-46d6d156e328 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:57.629496 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2193e5d3-b5b0-4245-a8aa-46d6d156e328 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:57.775691 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-2193e5d3-b5b0-4245-a8aa-46d6d156e328 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:00:57.783713 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-2193e5d3-b5b0-4245-a8aa-46d6d156e328 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1554 microversion: 2.1 time: 0.166881 Jul 14 18:00:57.784887 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 482/916] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:57 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:00:57.917044 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-640da8ba-c818-45ff-8d91-5f22e8c13f04 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:57.917765 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-640da8ba-c818-45ff-8d91-5f22e8c13f04 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: c25aaf9b-059d-4605-8607-8810702e9ee7] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:57.926494 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-640da8ba-c818-45ff-8d91-5f22e8c13f04 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:57.927059 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-640da8ba-c818-45ff-8d91-5f22e8c13f04 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:57.927916 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-640da8ba-c818-45ff-8d91-5f22e8c13f04 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:57.928479 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-640da8ba-c818-45ff-8d91-5f22e8c13f04 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:58.081982 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-640da8ba-c818-45ff-8d91-5f22e8c13f04 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:00:58.097023 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-640da8ba-c818-45ff-8d91-5f22e8c13f04 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7" status: 200 len: 1360 microversion: 2.1 time: 0.183253 Jul 14 18:00:58.098428 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 435/917] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:57 2022] GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7 => generated 1360 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:00:58.182591 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [req-049b1297-9583-4af4-a4d9-3893b3e292d0 req-618e579d-a8ee-4ce1-abe2-f0ce6bdd82c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c25aaf9b-059d-4605-8607-8810702e9ee7", "name": "network-vif-plugged", "status": "completed", "tag": "55ac38e4-f540-4ccf-a87b-fa51764aa743"}]} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:00:58.193091 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-049b1297-9583-4af4-a4d9-3893b3e292d0 req-618e579d-a8ee-4ce1-abe2-f0ce6bdd82c6 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:58.193748 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-049b1297-9583-4af4-a4d9-3893b3e292d0 req-618e579d-a8ee-4ce1-abe2-f0ce6bdd82c6 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:58.206878 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.compute.server_external_events [req-049b1297-9583-4af4-a4d9-3893b3e292d0 req-618e579d-a8ee-4ce1-abe2-f0ce6bdd82c6 service nova] Creating event network-vif-plugged:55ac38e4-f540-4ccf-a87b-fa51764aa743 for instance c25aaf9b-059d-4605-8607-8810702e9ee7 on hv-cinder-84989 Jul 14 18:00:58.213354 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [req-049b1297-9583-4af4-a4d9-3893b3e292d0 req-618e579d-a8ee-4ce1-abe2-f0ce6bdd82c6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037208 Jul 14 18:00:58.214185 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 483/918] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:00:58.802136 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-259cabe2-5082-4556-bbf5-8244b8a4d57a tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:58.802721 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-259cabe2-5082-4556-bbf5-8244b8a4d57a tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:58.809390 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-259cabe2-5082-4556-bbf5-8244b8a4d57a tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:58.809870 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-259cabe2-5082-4556-bbf5-8244b8a4d57a tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:58.810736 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-259cabe2-5082-4556-bbf5-8244b8a4d57a tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:58.811266 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-259cabe2-5082-4556-bbf5-8244b8a4d57a tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:58.975223 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-259cabe2-5082-4556-bbf5-8244b8a4d57a tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:00:58.986924 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-259cabe2-5082-4556-bbf5-8244b8a4d57a tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1554 microversion: 2.1 time: 0.188192 Jul 14 18:00:58.997451 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 436/919] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:58 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1554 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:00:59.116184 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-bcadbeb7-abb7-4eb5-841d-ec16e7ff2415 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:00:59.117599 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-bcadbeb7-abb7-4eb5-841d-ec16e7ff2415 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: c25aaf9b-059d-4605-8607-8810702e9ee7] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:00:59.125348 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bcadbeb7-abb7-4eb5-841d-ec16e7ff2415 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:59.126093 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bcadbeb7-abb7-4eb5-841d-ec16e7ff2415 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:59.127316 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bcadbeb7-abb7-4eb5-841d-ec16e7ff2415 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:59.127765 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bcadbeb7-abb7-4eb5-841d-ec16e7ff2415 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:59.348899 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-bcadbeb7-abb7-4eb5-841d-ec16e7ff2415 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:00:59.360001 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-bcadbeb7-abb7-4eb5-841d-ec16e7ff2415 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7" status: 200 len: 1360 microversion: 2.1 time: 0.248873 Jul 14 18:00:59.361236 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 484/920] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:59 2022] GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7 => generated 1360 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:00:59.366025 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-3ced7142-875d-4767-8083-78337df13ec9 req-1790c37f-15c3-4d5e-b4c2-b312c286e7a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06993daa-d7b7-4496-b60f-71da361f1c19", "name": "network-vif-deleted", "tag": "e4104856-b157-4b68-bc78-cbaf334757bd"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:00:59.376374 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-3ced7142-875d-4767-8083-78337df13ec9 req-1790c37f-15c3-4d5e-b4c2-b312c286e7a7 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:00:59.376847 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-3ced7142-875d-4767-8083-78337df13ec9 req-1790c37f-15c3-4d5e-b4c2-b312c286e7a7 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:00:59.388509 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-3ced7142-875d-4767-8083-78337df13ec9 req-1790c37f-15c3-4d5e-b4c2-b312c286e7a7 service nova] Creating event network-vif-deleted:e4104856-b157-4b68-bc78-cbaf334757bd for instance 06993daa-d7b7-4496-b60f-71da361f1c19 on hv-cinder-84989 Jul 14 18:00:59.394195 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-3ced7142-875d-4767-8083-78337df13ec9 req-1790c37f-15c3-4d5e-b4c2-b312c286e7a7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031629 Jul 14 18:00:59.396348 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 437/921] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 18:01:00.003423 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-90e969f8-21a3-4427-abc5-8a24db1baca5 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:01:00.004084 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-90e969f8-21a3-4427-abc5-8a24db1baca5 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:01:00.010067 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-90e969f8-21a3-4427-abc5-8a24db1baca5 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:00.010521 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-90e969f8-21a3-4427-abc5-8a24db1baca5 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:00.011293 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-90e969f8-21a3-4427-abc5-8a24db1baca5 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:00.011733 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-90e969f8-21a3-4427-abc5-8a24db1baca5 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:00.039159 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:01:00.043336 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-90e969f8-21a3-4427-abc5-8a24db1baca5 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:00.043778 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-90e969f8-21a3-4427-abc5-8a24db1baca5 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:00.044291 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.objects.instance [None req-90e969f8-21a3-4427-abc5-8a24db1baca5 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lazy-loading 'fault' on Instance uuid 06993daa-d7b7-4496-b60f-71da361f1c19 {{(pid=129471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 18:01:00.047413 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:01:00.088743 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-90e969f8-21a3-4427-abc5-8a24db1baca5 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:00.097365 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-90e969f8-21a3-4427-abc5-8a24db1baca5 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1348 microversion: 2.1 time: 0.098266 Jul 14 18:01:00.098106 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 485/922] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:00:59 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1348 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:01:00.377841 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-8ed979e9-f0b2-42da-beae-546d8879dfc9 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:01:00.379103 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-8ed979e9-f0b2-42da-beae-546d8879dfc9 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: c25aaf9b-059d-4605-8607-8810702e9ee7] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:01:00.385282 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8ed979e9-f0b2-42da-beae-546d8879dfc9 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:00.385748 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8ed979e9-f0b2-42da-beae-546d8879dfc9 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:00.386528 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8ed979e9-f0b2-42da-beae-546d8879dfc9 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:00.386975 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8ed979e9-f0b2-42da-beae-546d8879dfc9 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:00.522724 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-8ed979e9-f0b2-42da-beae-546d8879dfc9 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:00.526283 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:01:00.531222 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-8ed979e9-f0b2-42da-beae-546d8879dfc9 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7" status: 200 len: 1360 microversion: 2.1 time: 0.158097 Jul 14 18:01:00.532309 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 438/923] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:01:00 2022] GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7 => generated 1360 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:01:01.114920 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-49a22ca3-d750-4d40-9db2-b7d92d2f3f2e tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:01:01.115370 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-49a22ca3-d750-4d40-9db2-b7d92d2f3f2e tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:01:01.123186 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-49a22ca3-d750-4d40-9db2-b7d92d2f3f2e tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:01.123303 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-49a22ca3-d750-4d40-9db2-b7d92d2f3f2e tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:01.124112 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-49a22ca3-d750-4d40-9db2-b7d92d2f3f2e tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:01.124554 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-49a22ca3-d750-4d40-9db2-b7d92d2f3f2e tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:01.155662 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-49a22ca3-d750-4d40-9db2-b7d92d2f3f2e tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:01.156091 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-49a22ca3-d750-4d40-9db2-b7d92d2f3f2e tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:01.156548 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.objects.instance [None req-49a22ca3-d750-4d40-9db2-b7d92d2f3f2e tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lazy-loading 'fault' on Instance uuid 06993daa-d7b7-4496-b60f-71da361f1c19 {{(pid=129471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 18:01:01.201499 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-49a22ca3-d750-4d40-9db2-b7d92d2f3f2e tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3fd98743554b0a8bf1cea0523ed4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36825e7c014d48a7fe9375d9abdf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:01.209476 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-49a22ca3-d750-4d40-9db2-b7d92d2f3f2e tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 200 len: 1348 microversion: 2.1 time: 0.098609 Jul 14 18:01:01.210252 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 486/924] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:01:01 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 1348 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:01:01.552656 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-203f189c-1b73-4a1d-abbe-adec5066c50d tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:01:01.554210 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-203f189c-1b73-4a1d-abbe-adec5066c50d tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: c25aaf9b-059d-4605-8607-8810702e9ee7] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:01:01.565419 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-203f189c-1b73-4a1d-abbe-adec5066c50d tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:01.566153 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-203f189c-1b73-4a1d-abbe-adec5066c50d tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:01.567180 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-203f189c-1b73-4a1d-abbe-adec5066c50d tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:01.568208 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-203f189c-1b73-4a1d-abbe-adec5066c50d tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:01.736058 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-203f189c-1b73-4a1d-abbe-adec5066c50d tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:01.743682 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-203f189c-1b73-4a1d-abbe-adec5066c50d tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7" status: 200 len: 1546 microversion: 2.1 time: 0.198840 Jul 14 18:01:01.744293 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 439/925] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:01:01 2022] GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7 => generated 1546 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:01:01.760581 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-a0cecd2c-7dcb-4bf5-ad00-cb6eb37d5cf4 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:01:01.761103 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-a0cecd2c-7dcb-4bf5-ad00-cb6eb37d5cf4 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: c25aaf9b-059d-4605-8607-8810702e9ee7] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:01:01.767386 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a0cecd2c-7dcb-4bf5-ad00-cb6eb37d5cf4 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:01.767974 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a0cecd2c-7dcb-4bf5-ad00-cb6eb37d5cf4 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:01.768971 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a0cecd2c-7dcb-4bf5-ad00-cb6eb37d5cf4 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:01.769249 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a0cecd2c-7dcb-4bf5-ad00-cb6eb37d5cf4 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:01.857283 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-a0cecd2c-7dcb-4bf5-ad00-cb6eb37d5cf4 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100694 Jul 14 18:01:01.858137 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 487/926] 10.222.0.64 () {58 vars in 1274 bytes} [Thu Jul 14 18:01:01 2022] GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:01:02.449808 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-8ddb4342-92be-4da8-bb54-d34ea7d38fd3 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:01:02.450764 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-8ddb4342-92be-4da8-bb54-d34ea7d38fd3 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] [instance: 06993daa-d7b7-4496-b60f-71da361f1c19] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:01:02.459699 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8ddb4342-92be-4da8-bb54-d34ea7d38fd3 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:02.460514 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8ddb4342-92be-4da8-bb54-d34ea7d38fd3 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:02.461536 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8ddb4342-92be-4da8-bb54-d34ea7d38fd3 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:02.462116 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8ddb4342-92be-4da8-bb54-d34ea7d38fd3 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:02.477772 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.wsgi [None req-8ddb4342-92be-4da8-bb54-d34ea7d38fd3 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] HTTP exception thrown: Instance 06993daa-d7b7-4496-b60f-71da361f1c19 could not be found. Jul 14 18:01:02.479780 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-8ddb4342-92be-4da8-bb54-d34ea7d38fd3 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Request method failure captured: Jul 14 18:01:02.479780 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: request: GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 HTTP/1.1 Jul 14 18:01:02.479780 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept: application/json Jul 14 18:01:02.479780 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept-Encoding: identity Jul 14 18:01:02.479780 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Connection: close Jul 14 18:01:02.479780 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Length: 0 Jul 14 18:01:02.479780 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Type: application/json Jul 14 18:01:02.479780 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Host: 10.222.0.64 Jul 14 18:01:02.479780 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Openstack-System-Scope: None Jul 14 18:01:02.479780 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: User-Agent: python-urllib3/1.26.9 Jul 14 18:01:02.479780 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Auth-Token: gAAAAABi0FijIqMyDbDD1y9ldj26RxbKDE-BVI8QeM8tgwWPH94uXusIFGaEhoWz0D6R8AGiSS3Bimr5jvbbwJTMUo7uMmRk76Ph8u4RJnJpTiobUgjR5yL9LTgCN1lkWagmua9nrfaWz0IV59b-pYBy9EEKM92ez0NxA8gn_i3aPSH6yoO0IxQ Jul 14 18:01:02.479780 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Id: None Jul 14 18:01:02.479780 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Name: None Jul 14 18:01:02.479780 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Identity-Status: Confirmed Jul 14 18:01:02.479780 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Is-Admin-Project: True Jul 14 18:01:02.479780 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Id: default Jul 14 18:01:02.479780 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Name: Default Jul 14 18:01:02.479780 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Id: fa36825e7c014d48a7fe9375d9abdf7d Jul 14 18:01:02.479780 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Name: tempest-TestMinimumBasicScenario-436091456 Jul 14 18:01:02.479780 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Role: reader,member Jul 14 18:01:02.479780 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Roles: reader,member Jul 14 18:01:02.481341 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fa36825e7c014d48a7fe9375d9abdf7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/fa36825e7c014d48a7fe9375d9abdf7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fa36825e7c014d48a7fe9375d9abdf7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_fa36825e7c014d48a7fe9375d9abdf7d", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:01:02.481341 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant: tempest-TestMinimumBasicScenario-436091456 Jul 14 18:01:02.481341 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Id: fa36825e7c014d48a7fe9375d9abdf7d Jul 14 18:01:02.481341 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Name: tempest-TestMinimumBasicScenario-436091456 Jul 14 18:01:02.481341 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User: tempest-TestMinimumBasicScenario-436091456-project Jul 14 18:01:02.481341 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Id: default Jul 14 18:01:02.481341 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Name: Default Jul 14 18:01:02.481341 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Id: 3e3fd98743554b0a8bf1cea0523ed4ae Jul 14 18:01:02.481341 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Name: tempest-TestMinimumBasicScenario-436091456-project Jul 14 18:01:02.481341 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: method: > Jul 14 18:01:02.481341 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: exception: Instance 06993daa-d7b7-4496-b60f-71da361f1c19 could not be found. Jul 14 18:01:02.481341 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: action_args: {'id': '06993daa-d7b7-4496-b60f-71da361f1c19'} Jul 14 18:01:02.482167 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:01:02.482167 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:01:02.482167 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 18:01:02.482167 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 18:01:02.482167 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 18:01:02.482167 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 18:01:02.482167 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 18:01:02.482167 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 18:01:02.482167 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 18:01:02.482167 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 18:01:02.482167 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06993daa-d7b7-4496-b60f-71da361f1c19 could not be found. Jul 14 18:01:02.482167 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:01:02.482167 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:01:02.482167 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:01:02.482167 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:01:02.482167 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:01:02.482167 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:01:02.482167 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:01:02.482167 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:01:02.482167 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:01:02.483699 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:01:02.483699 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 18:01:02.483699 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 18:01:02.483699 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 18:01:02.483699 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 18:01:02.483699 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 18:01:02.483699 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 18:01:02.483699 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06993daa-d7b7-4496-b60f-71da361f1c19 could not be found. Jul 14 18:01:02.483699 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:01:02.483699 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:01:02.483699 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:01:02.483699 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:01:02.483699 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:01:02.483699 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:01:02.483699 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 18:01:02.483699 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 18:01:02.483699 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06993daa-d7b7-4496-b60f-71da361f1c19 could not be found. Jul 14 18:01:02.483699 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:01:02.486265 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-8ddb4342-92be-4da8-bb54-d34ea7d38fd3 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Returning 404 to user: Instance 06993daa-d7b7-4496-b60f-71da361f1c19 could not be found. {{(pid=129470) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:01:02.488498 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-8ddb4342-92be-4da8-bb54-d34ea7d38fd3 tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19" status: 404 len: 111 microversion: 2.1 time: 0.265933 Jul 14 18:01:02.489779 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 440/927] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:01:02 2022] GET /compute/v2.1/servers/06993daa-d7b7-4496-b60f-71da361f1c19 => generated 111 bytes in 267 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 18:01:02.501412 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-91f0fcb6-04a4-43b2-bf9e-a14b228f084f tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] Calling method '.version_select at 0x7f137b6a2b80>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:01:02.523562 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-91f0fcb6-04a4-43b2-bf9e-a14b228f084f tempest-TestMinimumBasicScenario-436091456 tempest-TestMinimumBasicScenario-436091456-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1189023489" status: 202 len: 0 microversion: 2.1 time: 0.025922 Jul 14 18:01:02.524831 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 488/928] 10.222.0.64 () {58 vars in 1271 bytes} [Thu Jul 14 18:01:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1189023489 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 18:01:02.906920 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-90d774f4-8828-4f26-a4c1-3f871e4bd30a req-9adc3870-2e29-4c2d-8498-ce3eb81c111e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c25aaf9b-059d-4605-8607-8810702e9ee7", "tag": "55ac38e4-f540-4ccf-a87b-fa51764aa743"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:01:02.924884 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-90d774f4-8828-4f26-a4c1-3f871e4bd30a req-9adc3870-2e29-4c2d-8498-ce3eb81c111e service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:02.925822 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-90d774f4-8828-4f26-a4c1-3f871e4bd30a req-9adc3870-2e29-4c2d-8498-ce3eb81c111e service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:02.950432 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-90d774f4-8828-4f26-a4c1-3f871e4bd30a req-9adc3870-2e29-4c2d-8498-ce3eb81c111e service nova] Creating event network-changed:55ac38e4-f540-4ccf-a87b-fa51764aa743 for instance c25aaf9b-059d-4605-8607-8810702e9ee7 on hv-cinder-84989 Jul 14 18:01:02.956437 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-90d774f4-8828-4f26-a4c1-3f871e4bd30a req-9adc3870-2e29-4c2d-8498-ce3eb81c111e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054969 Jul 14 18:01:02.960142 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 441/929] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:01:42.666367 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=14 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:01:42.667045 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:01:42.671254 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-de7825a0-198a-4e5f-aee8-f3268eb7bab3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:01:42.671834 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-de7825a0-198a-4e5f-aee8-f3268eb7bab3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:01:42.679800 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-de7825a0-198a-4e5f-aee8-f3268eb7bab3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:42.680277 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-de7825a0-198a-4e5f-aee8-f3268eb7bab3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:42.681052 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-de7825a0-198a-4e5f-aee8-f3268eb7bab3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:42.681488 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-de7825a0-198a-4e5f-aee8-f3268eb7bab3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:42.705980 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-de7825a0-198a-4e5f-aee8-f3268eb7bab3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec/ips" status: 200 len: 153 microversion: 2.20 time: 0.041965 Jul 14 18:01:42.706563 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 489/930] 10.222.0.64 () {60 vars in 1288 bytes} [Thu Jul 14 18:01:42 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec/ips => generated 153 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 18:01:44.514984 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_api:SELECT=14 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:01:44.515823 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=10 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:01:44.520464 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-88778088-988a-4fcc-aa6b-54adb63306b6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:01:44.521776 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-88778088-988a-4fcc-aa6b-54adb63306b6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:01:44.528934 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-88778088-988a-4fcc-aa6b-54adb63306b6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:44.529392 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-88778088-988a-4fcc-aa6b-54adb63306b6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:44.530177 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-88778088-988a-4fcc-aa6b-54adb63306b6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:44.530620 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-88778088-988a-4fcc-aa6b-54adb63306b6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:44.553817 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.objects.instance [None req-88778088-988a-4fcc-aa6b-54adb63306b6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lazy-loading 'flavor' on Instance uuid 509b127f-76cb-4358-84a9-457d4e0397ec {{(pid=129470) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 18:01:44.818824 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-88778088-988a-4fcc-aa6b-54adb63306b6 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "POST /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec/action" status: 202 len: 0 microversion: 2.20 time: 0.304623 Jul 14 18:01:44.819381 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 442/931] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Jul 14 18:01:44 2022] POST /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 18:01:44.827953 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-853a7336-ebe8-4b7f-ad9b-329f14dfa0e2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:01:44.828731 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-853a7336-ebe8-4b7f-ad9b-329f14dfa0e2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:01:44.835880 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-853a7336-ebe8-4b7f-ad9b-329f14dfa0e2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:44.836384 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-853a7336-ebe8-4b7f-ad9b-329f14dfa0e2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:44.837215 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-853a7336-ebe8-4b7f-ad9b-329f14dfa0e2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:44.837712 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-853a7336-ebe8-4b7f-ad9b-329f14dfa0e2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:44.975426 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-853a7336-ebe8-4b7f-ad9b-329f14dfa0e2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:44.983409 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-853a7336-ebe8-4b7f-ad9b-329f14dfa0e2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:44.984948 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-853a7336-ebe8-4b7f-ad9b-329f14dfa0e2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:44.986142 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-853a7336-ebe8-4b7f-ad9b-329f14dfa0e2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1726 microversion: 2.20 time: 0.162435 Jul 14 18:01:44.986702 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 490/932] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:01:44 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:01:46.006523 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-d1aca922-e926-4bfa-99d1-8124424fc63b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:01:46.007215 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-d1aca922-e926-4bfa-99d1-8124424fc63b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:01:46.013594 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d1aca922-e926-4bfa-99d1-8124424fc63b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:46.014043 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d1aca922-e926-4bfa-99d1-8124424fc63b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:46.014806 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d1aca922-e926-4bfa-99d1-8124424fc63b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:46.015244 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d1aca922-e926-4bfa-99d1-8124424fc63b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:46.145718 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-d1aca922-e926-4bfa-99d1-8124424fc63b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:46.153588 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-d1aca922-e926-4bfa-99d1-8124424fc63b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:46.155136 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-d1aca922-e926-4bfa-99d1-8124424fc63b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:46.156321 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-d1aca922-e926-4bfa-99d1-8124424fc63b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1726 microversion: 2.20 time: 0.155041 Jul 14 18:01:46.156866 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 443/933] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:01:45 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 18:01:47.174441 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-3f9d605a-66de-4f35-abd8-40452d400f2f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:01:47.175056 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-3f9d605a-66de-4f35-abd8-40452d400f2f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:01:47.182550 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3f9d605a-66de-4f35-abd8-40452d400f2f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:47.183003 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3f9d605a-66de-4f35-abd8-40452d400f2f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:47.183806 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3f9d605a-66de-4f35-abd8-40452d400f2f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:47.184275 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3f9d605a-66de-4f35-abd8-40452d400f2f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:47.314290 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-3f9d605a-66de-4f35-abd8-40452d400f2f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:47.322454 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-3f9d605a-66de-4f35-abd8-40452d400f2f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:47.324089 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-3f9d605a-66de-4f35-abd8-40452d400f2f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:47.325339 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-3f9d605a-66de-4f35-abd8-40452d400f2f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1726 microversion: 2.20 time: 0.154829 Jul 14 18:01:47.325923 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 491/934] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:01:47 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:01:48.343795 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-ea9f3094-19d7-425b-b57d-7339f01bd010 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:01:48.344428 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-ea9f3094-19d7-425b-b57d-7339f01bd010 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:01:48.351560 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ea9f3094-19d7-425b-b57d-7339f01bd010 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:48.352038 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ea9f3094-19d7-425b-b57d-7339f01bd010 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:48.352812 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ea9f3094-19d7-425b-b57d-7339f01bd010 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:48.353242 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ea9f3094-19d7-425b-b57d-7339f01bd010 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:48.701625 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-ea9f3094-19d7-425b-b57d-7339f01bd010 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:48.710530 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-ea9f3094-19d7-425b-b57d-7339f01bd010 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:48.712073 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-ea9f3094-19d7-425b-b57d-7339f01bd010 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:48.713254 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-ea9f3094-19d7-425b-b57d-7339f01bd010 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1726 microversion: 2.20 time: 0.373354 Jul 14 18:01:48.713818 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 444/935] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:01:48 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1726 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:01:49.731673 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-ec82e1c8-59c4-4f31-a95a-0dfb91c77de2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:01:49.732410 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-ec82e1c8-59c4-4f31-a95a-0dfb91c77de2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:01:49.739691 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ec82e1c8-59c4-4f31-a95a-0dfb91c77de2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:49.740602 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ec82e1c8-59c4-4f31-a95a-0dfb91c77de2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:49.740998 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ec82e1c8-59c4-4f31-a95a-0dfb91c77de2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:49.741436 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ec82e1c8-59c4-4f31-a95a-0dfb91c77de2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:49.875806 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-ec82e1c8-59c4-4f31-a95a-0dfb91c77de2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:49.884332 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-ec82e1c8-59c4-4f31-a95a-0dfb91c77de2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:49.885836 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-ec82e1c8-59c4-4f31-a95a-0dfb91c77de2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:49.887011 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-ec82e1c8-59c4-4f31-a95a-0dfb91c77de2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1726 microversion: 2.20 time: 0.159574 Jul 14 18:01:49.887567 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 492/936] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:01:49 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:01:50.907976 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-21485c57-bac2-491c-8b8e-572f29350ee2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:01:50.908600 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-21485c57-bac2-491c-8b8e-572f29350ee2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:01:50.915550 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-21485c57-bac2-491c-8b8e-572f29350ee2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:50.916035 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-21485c57-bac2-491c-8b8e-572f29350ee2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:50.916818 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-21485c57-bac2-491c-8b8e-572f29350ee2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:50.917260 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-21485c57-bac2-491c-8b8e-572f29350ee2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:51.057695 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-21485c57-bac2-491c-8b8e-572f29350ee2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:51.066109 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-21485c57-bac2-491c-8b8e-572f29350ee2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:51.067604 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-21485c57-bac2-491c-8b8e-572f29350ee2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:51.068795 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-21485c57-bac2-491c-8b8e-572f29350ee2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1726 microversion: 2.20 time: 0.166479 Jul 14 18:01:51.069347 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 445/937] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:01:50 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:01:52.089122 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-194f053f-beae-44fc-8255-d8e03ab738ab tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:01:52.090124 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-194f053f-beae-44fc-8255-d8e03ab738ab tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:01:52.101088 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-194f053f-beae-44fc-8255-d8e03ab738ab tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:52.101535 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-194f053f-beae-44fc-8255-d8e03ab738ab tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:52.102327 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-194f053f-beae-44fc-8255-d8e03ab738ab tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:52.102767 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-194f053f-beae-44fc-8255-d8e03ab738ab tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:52.291710 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-194f053f-beae-44fc-8255-d8e03ab738ab tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:52.299756 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-194f053f-beae-44fc-8255-d8e03ab738ab tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:52.301392 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-194f053f-beae-44fc-8255-d8e03ab738ab tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:52.302471 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-194f053f-beae-44fc-8255-d8e03ab738ab tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1726 microversion: 2.20 time: 0.218847 Jul 14 18:01:52.303033 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 493/938] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:01:52 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1726 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:01:53.320641 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-59799618-df18-462c-a817-525cb0f21a33 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:01:53.321192 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-59799618-df18-462c-a817-525cb0f21a33 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:01:53.328675 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-59799618-df18-462c-a817-525cb0f21a33 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:53.329130 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-59799618-df18-462c-a817-525cb0f21a33 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:53.329931 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-59799618-df18-462c-a817-525cb0f21a33 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:53.330374 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-59799618-df18-462c-a817-525cb0f21a33 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:53.470654 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-59799618-df18-462c-a817-525cb0f21a33 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:53.478800 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-59799618-df18-462c-a817-525cb0f21a33 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:53.480344 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-59799618-df18-462c-a817-525cb0f21a33 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:53.481518 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-59799618-df18-462c-a817-525cb0f21a33 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1726 microversion: 2.20 time: 0.164926 Jul 14 18:01:53.482075 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 446/939] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:01:53 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:01:54.500211 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-827e52ba-09ba-4a9d-bc6d-ed19beeeb809 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:01:54.500829 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-827e52ba-09ba-4a9d-bc6d-ed19beeeb809 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:01:54.507424 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-827e52ba-09ba-4a9d-bc6d-ed19beeeb809 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:54.507878 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-827e52ba-09ba-4a9d-bc6d-ed19beeeb809 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:54.508686 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-827e52ba-09ba-4a9d-bc6d-ed19beeeb809 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:54.509133 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-827e52ba-09ba-4a9d-bc6d-ed19beeeb809 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:54.640492 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-827e52ba-09ba-4a9d-bc6d-ed19beeeb809 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:54.648632 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-827e52ba-09ba-4a9d-bc6d-ed19beeeb809 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:54.650148 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-827e52ba-09ba-4a9d-bc6d-ed19beeeb809 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:54.651352 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-827e52ba-09ba-4a9d-bc6d-ed19beeeb809 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1726 microversion: 2.20 time: 0.155654 Jul 14 18:01:54.651916 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 494/940] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:01:54 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:01:55.669546 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-0be5dd53-a198-4066-900f-09bc37cbf814 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:01:55.670286 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-0be5dd53-a198-4066-900f-09bc37cbf814 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:01:55.677086 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0be5dd53-a198-4066-900f-09bc37cbf814 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:55.677530 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0be5dd53-a198-4066-900f-09bc37cbf814 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:55.678293 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0be5dd53-a198-4066-900f-09bc37cbf814 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:55.678726 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-0be5dd53-a198-4066-900f-09bc37cbf814 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:55.823015 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-0be5dd53-a198-4066-900f-09bc37cbf814 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:55.832085 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-0be5dd53-a198-4066-900f-09bc37cbf814 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:55.833613 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-0be5dd53-a198-4066-900f-09bc37cbf814 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:55.834805 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-0be5dd53-a198-4066-900f-09bc37cbf814 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1726 microversion: 2.20 time: 0.169210 Jul 14 18:01:55.835377 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 447/941] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:01:55 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:01:56.821957 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-d019d7e5-e5b9-4ef3-b0bf-8408bec8ea8f tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:01:56.822978 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-d019d7e5-e5b9-4ef3-b0bf-8408bec8ea8f tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:01:56.828853 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-5a0a82f2-9531-4cd3-8c64-84b44197f32a req-41ff3a47-c6ab-45b8-b8fb-2395fda445ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28947673-5bde-4923-9e70-bec5086fe9c6", "tag": "2f38f011-fe4c-4851-b4df-370ae6045e1f"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:01:56.832461 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d019d7e5-e5b9-4ef3-b0bf-8408bec8ea8f tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:56.833320 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d019d7e5-e5b9-4ef3-b0bf-8408bec8ea8f tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:56.834504 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d019d7e5-e5b9-4ef3-b0bf-8408bec8ea8f tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:56.835120 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d019d7e5-e5b9-4ef3-b0bf-8408bec8ea8f tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:56.839857 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-5a0a82f2-9531-4cd3-8c64-84b44197f32a req-41ff3a47-c6ab-45b8-b8fb-2395fda445ba service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:56.840717 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-5a0a82f2-9531-4cd3-8c64-84b44197f32a req-41ff3a47-c6ab-45b8-b8fb-2395fda445ba service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:56.858207 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-5a0a82f2-9531-4cd3-8c64-84b44197f32a req-41ff3a47-c6ab-45b8-b8fb-2395fda445ba service nova] Creating event network-changed:2f38f011-fe4c-4851-b4df-370ae6045e1f for instance 28947673-5bde-4923-9e70-bec5086fe9c6 on hv-cinder-84989 Jul 14 18:01:56.866939 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-5a0a82f2-9531-4cd3-8c64-84b44197f32a req-41ff3a47-c6ab-45b8-b8fb-2395fda445ba service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041963 Jul 14 18:01:56.869969 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 448/942] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:01:56.881164 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-4611a871-ebc0-4d95-b994-a1ae38464fdc tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:01:56.882421 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-4611a871-ebc0-4d95-b994-a1ae38464fdc tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:01:56.885757 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-d019d7e5-e5b9-4ef3-b0bf-8408bec8ea8f tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Going to try to terminate instance {{(pid=129471) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 18:01:56.895021 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4611a871-ebc0-4d95-b994-a1ae38464fdc tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:56.895761 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4611a871-ebc0-4d95-b994-a1ae38464fdc tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:56.896947 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4611a871-ebc0-4d95-b994-a1ae38464fdc tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:56.897603 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4611a871-ebc0-4d95-b994-a1ae38464fdc tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:57.001261 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-d019d7e5-e5b9-4ef3-b0bf-8408bec8ea8f tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "DELETE /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 204 len: 0 microversion: 2.1 time: 0.182364 Jul 14 18:01:57.003757 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 495/943] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Jul 14 18:01:56 2022] DELETE /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 18:01:57.016341 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-79c7fabc-bbca-4bca-bfc3-919e029f6d69 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:01:57.017460 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-79c7fabc-bbca-4bca-bfc3-919e029f6d69 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:01:57.026914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-79c7fabc-bbca-4bca-bfc3-919e029f6d69 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:57.027435 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-79c7fabc-bbca-4bca-bfc3-919e029f6d69 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:57.029470 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-79c7fabc-bbca-4bca-bfc3-919e029f6d69 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:57.030049 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-79c7fabc-bbca-4bca-bfc3-919e029f6d69 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:57.246416 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-4611a871-ebc0-4d95-b994-a1ae38464fdc tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:57.263381 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-4611a871-ebc0-4d95-b994-a1ae38464fdc tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:57.265903 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-4611a871-ebc0-4d95-b994-a1ae38464fdc tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:57.269324 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-4611a871-ebc0-4d95-b994-a1ae38464fdc tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1726 microversion: 2.20 time: 0.397980 Jul 14 18:01:57.270948 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 449/944] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:01:56 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1726 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:01:57.273512 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-79c7fabc-bbca-4bca-bfc3-919e029f6d69 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:57.286307 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-79c7fabc-bbca-4bca-bfc3-919e029f6d69 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1569 microversion: 2.1 time: 0.277609 Jul 14 18:01:57.296882 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 496/945] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:01:57 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1569 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:01:58.288709 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-a59dd45c-bc8c-4f16-b52c-c8f98be9784f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:01:58.289427 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-a59dd45c-bc8c-4f16-b52c-c8f98be9784f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:01:58.296989 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a59dd45c-bc8c-4f16-b52c-c8f98be9784f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:58.297447 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a59dd45c-bc8c-4f16-b52c-c8f98be9784f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:58.298331 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a59dd45c-bc8c-4f16-b52c-c8f98be9784f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:58.298925 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a59dd45c-bc8c-4f16-b52c-c8f98be9784f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:58.304377 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-7002d59a-b850-4889-ac02-f95c982cab84 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:01:58.305770 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-7002d59a-b850-4889-ac02-f95c982cab84 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:01:58.313244 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7002d59a-b850-4889-ac02-f95c982cab84 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:58.313979 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7002d59a-b850-4889-ac02-f95c982cab84 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:58.314935 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7002d59a-b850-4889-ac02-f95c982cab84 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:58.315724 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7002d59a-b850-4889-ac02-f95c982cab84 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:58.497752 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-a59dd45c-bc8c-4f16-b52c-c8f98be9784f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:58.505740 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-a59dd45c-bc8c-4f16-b52c-c8f98be9784f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:58.506458 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-7002d59a-b850-4889-ac02-f95c982cab84 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:58.507259 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-a59dd45c-bc8c-4f16-b52c-c8f98be9784f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:58.508468 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-a59dd45c-bc8c-4f16-b52c-c8f98be9784f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1726 microversion: 2.20 time: 0.223757 Jul 14 18:01:58.509023 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 450/946] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:01:58 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1726 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:01:58.514529 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-7002d59a-b850-4889-ac02-f95c982cab84 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1569 microversion: 2.1 time: 0.214275 Jul 14 18:01:58.515088 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 497/947] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:01:58 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1569 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:01:59.454947 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-a83e3289-0cc0-4bd1-aa78-6b46b9237776 req-b728b03a-afcf-4e88-aa99-60ef3b41d155 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28947673-5bde-4923-9e70-bec5086fe9c6", "name": "network-vif-deleted", "tag": "2f38f011-fe4c-4851-b4df-370ae6045e1f"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:01:59.466190 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-a83e3289-0cc0-4bd1-aa78-6b46b9237776 req-b728b03a-afcf-4e88-aa99-60ef3b41d155 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:59.466634 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-a83e3289-0cc0-4bd1-aa78-6b46b9237776 req-b728b03a-afcf-4e88-aa99-60ef3b41d155 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:59.480047 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-a83e3289-0cc0-4bd1-aa78-6b46b9237776 req-b728b03a-afcf-4e88-aa99-60ef3b41d155 service nova] Creating event network-vif-deleted:2f38f011-fe4c-4851-b4df-370ae6045e1f for instance 28947673-5bde-4923-9e70-bec5086fe9c6 on hv-cinder-84989 Jul 14 18:01:59.486808 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-a83e3289-0cc0-4bd1-aa78-6b46b9237776 req-b728b03a-afcf-4e88-aa99-60ef3b41d155 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036306 Jul 14 18:01:59.487838 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 451/948] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:01:59.528581 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-e946011b-106b-4ad1-8797-f1c1d7f9972c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:01:59.529190 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-e946011b-106b-4ad1-8797-f1c1d7f9972c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:01:59.540546 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-40180722-cf21-4bf9-bf3a-08a5bd1df1b3 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:01:59.541309 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-40180722-cf21-4bf9-bf3a-08a5bd1df1b3 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:01:59.544035 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e946011b-106b-4ad1-8797-f1c1d7f9972c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:59.544490 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e946011b-106b-4ad1-8797-f1c1d7f9972c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:59.545298 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e946011b-106b-4ad1-8797-f1c1d7f9972c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:59.545739 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e946011b-106b-4ad1-8797-f1c1d7f9972c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:59.553610 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-40180722-cf21-4bf9-bf3a-08a5bd1df1b3 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:59.554170 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-40180722-cf21-4bf9-bf3a-08a5bd1df1b3 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:59.554846 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-40180722-cf21-4bf9-bf3a-08a5bd1df1b3 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:01:59.555287 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-40180722-cf21-4bf9-bf3a-08a5bd1df1b3 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:01:59.660684 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-40180722-cf21-4bf9-bf3a-08a5bd1df1b3 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:59.669144 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-40180722-cf21-4bf9-bf3a-08a5bd1df1b3 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1219 microversion: 2.1 time: 0.134876 Jul 14 18:01:59.669772 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 452/949] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:01:59 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1219 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:01:59.736977 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-e946011b-106b-4ad1-8797-f1c1d7f9972c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:59.746284 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-e946011b-106b-4ad1-8797-f1c1d7f9972c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:59.747828 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-e946011b-106b-4ad1-8797-f1c1d7f9972c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:01:59.749333 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-e946011b-106b-4ad1-8797-f1c1d7f9972c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1726 microversion: 2.20 time: 0.225517 Jul 14 18:01:59.749911 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 498/950] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:01:59 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1726 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:02:00.687004 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-943a3d55-0307-4364-b105-4875127f1e8b tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:00.687889 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-943a3d55-0307-4364-b105-4875127f1e8b tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:00.695590 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-943a3d55-0307-4364-b105-4875127f1e8b tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:00.696154 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-943a3d55-0307-4364-b105-4875127f1e8b tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:00.697102 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-943a3d55-0307-4364-b105-4875127f1e8b tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:00.697613 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-943a3d55-0307-4364-b105-4875127f1e8b tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:00.733586 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-943a3d55-0307-4364-b105-4875127f1e8b tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:00.734045 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-943a3d55-0307-4364-b105-4875127f1e8b tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:00.734511 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.objects.instance [None req-943a3d55-0307-4364-b105-4875127f1e8b tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lazy-loading 'fault' on Instance uuid 28947673-5bde-4923-9e70-bec5086fe9c6 {{(pid=129470) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 18:02:00.771753 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-427accd0-14bb-449b-be5a-347dcd37e863 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:00.773141 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-427accd0-14bb-449b-be5a-347dcd37e863 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:00.791023 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-427accd0-14bb-449b-be5a-347dcd37e863 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:00.791908 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-427accd0-14bb-449b-be5a-347dcd37e863 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:00.793011 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-427accd0-14bb-449b-be5a-347dcd37e863 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:00.793674 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-427accd0-14bb-449b-be5a-347dcd37e863 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:00.806155 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-943a3d55-0307-4364-b105-4875127f1e8b tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d24ace76e3e4f10b63a53bb7482ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96004c35e9a84f2ab6b0601e28f45627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:00.814319 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-943a3d55-0307-4364-b105-4875127f1e8b tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 200 len: 1178 microversion: 2.1 time: 0.131500 Jul 14 18:02:00.814909 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 453/951] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:02:00 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 1178 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:02:01.003346 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-427accd0-14bb-449b-be5a-347dcd37e863 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:01.012534 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-427accd0-14bb-449b-be5a-347dcd37e863 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:01.014060 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-427accd0-14bb-449b-be5a-347dcd37e863 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:01.015276 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-427accd0-14bb-449b-be5a-347dcd37e863 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1726 microversion: 2.20 time: 0.250196 Jul 14 18:02:01.015833 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 499/952] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:00 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1726 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:02:01.835465 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-b475cb7e-047e-4852-83ac-109817ab78a1 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:01.836118 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-b475cb7e-047e-4852-83ac-109817ab78a1 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] [instance: 28947673-5bde-4923-9e70-bec5086fe9c6] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:01.843267 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b475cb7e-047e-4852-83ac-109817ab78a1 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:01.843721 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b475cb7e-047e-4852-83ac-109817ab78a1 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:01.844534 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b475cb7e-047e-4852-83ac-109817ab78a1 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:01.844978 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b475cb7e-047e-4852-83ac-109817ab78a1 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:01.859438 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.wsgi [None req-b475cb7e-047e-4852-83ac-109817ab78a1 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] HTTP exception thrown: Instance 28947673-5bde-4923-9e70-bec5086fe9c6 could not be found. Jul 14 18:02:01.861335 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-b475cb7e-047e-4852-83ac-109817ab78a1 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Request method failure captured: Jul 14 18:02:01.861335 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: request: GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 HTTP/1.1 Jul 14 18:02:01.861335 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept: application/json Jul 14 18:02:01.861335 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept-Encoding: identity Jul 14 18:02:01.861335 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Connection: close Jul 14 18:02:01.861335 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Length: 0 Jul 14 18:02:01.861335 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Type: application/json Jul 14 18:02:01.861335 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Host: 10.222.0.64 Jul 14 18:02:01.861335 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Openstack-System-Scope: None Jul 14 18:02:01.861335 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: User-Agent: python-urllib3/1.26.9 Jul 14 18:02:01.861335 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Auth-Token: gAAAAABi0Fhm6-9II5WpuSMhQH0XdZ8MvIjec6-o3bX7v4MdLYp06Hdamvjtrb8bR8gGSJhVe_37F2rf0RPZqoYvCTzkWw5FvxSC59iFJ-pRIlIv2N6YV2zt9zSoq3QiPViOey0PlUDQO0OTBHkBdlH5KJ22WOaykmGstEa4rkZ2GVs5xBOti_I Jul 14 18:02:01.861335 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Id: None Jul 14 18:02:01.861335 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Name: None Jul 14 18:02:01.861335 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Identity-Status: Confirmed Jul 14 18:02:01.861335 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Is-Admin-Project: True Jul 14 18:02:01.861335 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Id: default Jul 14 18:02:01.861335 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Name: Default Jul 14 18:02:01.861335 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Id: 96004c35e9a84f2ab6b0601e28f45627 Jul 14 18:02:01.861335 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Name: tempest-TestShelveInstance-145310017 Jul 14 18:02:01.861335 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Role: reader,member Jul 14 18:02:01.861335 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Roles: reader,member Jul 14 18:02:01.863073 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/96004c35e9a84f2ab6b0601e28f45627"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/96004c35e9a84f2ab6b0601e28f45627"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/96004c35e9a84f2ab6b0601e28f45627"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_96004c35e9a84f2ab6b0601e28f45627", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:02:01.863073 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant: tempest-TestShelveInstance-145310017 Jul 14 18:02:01.863073 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Id: 96004c35e9a84f2ab6b0601e28f45627 Jul 14 18:02:01.863073 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Name: tempest-TestShelveInstance-145310017 Jul 14 18:02:01.863073 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User: tempest-TestShelveInstance-145310017-project Jul 14 18:02:01.863073 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Id: default Jul 14 18:02:01.863073 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Name: Default Jul 14 18:02:01.863073 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Id: 5d24ace76e3e4f10b63a53bb7482ac07 Jul 14 18:02:01.863073 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Name: tempest-TestShelveInstance-145310017-project Jul 14 18:02:01.863073 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: method: > Jul 14 18:02:01.863073 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: exception: Instance 28947673-5bde-4923-9e70-bec5086fe9c6 could not be found. Jul 14 18:02:01.863073 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: action_args: {'id': '28947673-5bde-4923-9e70-bec5086fe9c6'} Jul 14 18:02:01.863989 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:02:01.863989 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:02:01.863989 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 18:02:01.863989 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 18:02:01.863989 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 18:02:01.863989 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 18:02:01.863989 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 18:02:01.863989 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 18:02:01.863989 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 18:02:01.863989 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 18:02:01.863989 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28947673-5bde-4923-9e70-bec5086fe9c6 could not be found. Jul 14 18:02:01.863989 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:02:01.863989 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:02:01.863989 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:02:01.863989 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:02:01.863989 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:02:01.863989 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:02:01.863989 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:02:01.863989 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:02:01.863989 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:02:01.865520 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:02:01.865520 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 18:02:01.865520 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 18:02:01.865520 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 18:02:01.865520 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 18:02:01.865520 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 18:02:01.865520 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 18:02:01.865520 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28947673-5bde-4923-9e70-bec5086fe9c6 could not be found. Jul 14 18:02:01.865520 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:02:01.865520 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:02:01.865520 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:02:01.865520 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:02:01.865520 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:02:01.865520 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:02:01.865520 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 18:02:01.865520 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 18:02:01.865520 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28947673-5bde-4923-9e70-bec5086fe9c6 could not be found. Jul 14 18:02:01.865520 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:02:01.866895 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-b475cb7e-047e-4852-83ac-109817ab78a1 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Returning 404 to user: Instance 28947673-5bde-4923-9e70-bec5086fe9c6 could not be found. {{(pid=129470) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:02:01.866895 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-b475cb7e-047e-4852-83ac-109817ab78a1 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6" status: 404 len: 111 microversion: 2.1 time: 0.032240 Jul 14 18:02:01.866895 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 454/953] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:02:01 2022] GET /compute/v2.1/servers/28947673-5bde-4923-9e70-bec5086fe9c6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 18:02:02.034601 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-459043f5-6365-43c0-96e3-10d7c857ef78 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:02.035235 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-459043f5-6365-43c0-96e3-10d7c857ef78 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:02.044855 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-04b4edf3-e46b-401b-899a-558b5dfd3c83 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] Calling method '.version_select at 0x7f137afb9430>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:02.051824 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-459043f5-6365-43c0-96e3-10d7c857ef78 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:02.052534 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-459043f5-6365-43c0-96e3-10d7c857ef78 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:02.053527 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-459043f5-6365-43c0-96e3-10d7c857ef78 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:02.054150 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-459043f5-6365-43c0-96e3-10d7c857ef78 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:02.076316 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-04b4edf3-e46b-401b-899a-558b5dfd3c83 tempest-TestShelveInstance-145310017 tempest-TestShelveInstance-145310017-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2119343121" status: 202 len: 0 microversion: 2.1 time: 0.035979 Jul 14 18:02:02.084705 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 455/954] 10.222.0.64 () {58 vars in 1253 bytes} [Thu Jul 14 18:02:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2119343121 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 18:02:02.305652 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-459043f5-6365-43c0-96e3-10d7c857ef78 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:02.317808 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-459043f5-6365-43c0-96e3-10d7c857ef78 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:02.320252 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-459043f5-6365-43c0-96e3-10d7c857ef78 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:02.321938 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-459043f5-6365-43c0-96e3-10d7c857ef78 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1747 microversion: 2.20 time: 0.291377 Jul 14 18:02:02.323630 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 500/955] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:02 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1747 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:02:03.345153 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-3beb77b9-e6d3-406d-ae27-b8ce2b2a8993 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:03.346031 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-3beb77b9-e6d3-406d-ae27-b8ce2b2a8993 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:03.355834 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3beb77b9-e6d3-406d-ae27-b8ce2b2a8993 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:03.356417 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3beb77b9-e6d3-406d-ae27-b8ce2b2a8993 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:03.357297 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3beb77b9-e6d3-406d-ae27-b8ce2b2a8993 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:03.357809 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3beb77b9-e6d3-406d-ae27-b8ce2b2a8993 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:03.800907 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-3beb77b9-e6d3-406d-ae27-b8ce2b2a8993 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:03.814699 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-3beb77b9-e6d3-406d-ae27-b8ce2b2a8993 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:03.816304 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-3beb77b9-e6d3-406d-ae27-b8ce2b2a8993 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:03.817532 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-3beb77b9-e6d3-406d-ae27-b8ce2b2a8993 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1747 microversion: 2.20 time: 0.478658 Jul 14 18:02:03.818103 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 456/956] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:03 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1747 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:02:04.843426 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-d72f6298-4f28-4259-a585-16b4717079fe tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:04.844132 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-d72f6298-4f28-4259-a585-16b4717079fe tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:04.851887 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d72f6298-4f28-4259-a585-16b4717079fe tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:04.853137 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d72f6298-4f28-4259-a585-16b4717079fe tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:04.854303 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d72f6298-4f28-4259-a585-16b4717079fe tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:04.854973 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d72f6298-4f28-4259-a585-16b4717079fe tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:05.044067 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-d72f6298-4f28-4259-a585-16b4717079fe tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:05.057755 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-d72f6298-4f28-4259-a585-16b4717079fe tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:05.061326 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-d72f6298-4f28-4259-a585-16b4717079fe tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:05.063514 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-d72f6298-4f28-4259-a585-16b4717079fe tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1747 microversion: 2.20 time: 0.226043 Jul 14 18:02:05.064960 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 501/957] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:04 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1747 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:02:05.423346 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-135d99ab-0d34-4be6-8db1-57e1d6ea5617 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-281921154", "imageRef": "cf1f5d8c-9e49-4272-8e19-8e3c587056e1", "flavorRef": "452", "networks": [{"uuid": "bc78a282-f93c-447e-aeef-e773d7815fbd"}]}} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:02:05.480444 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.network.neutron [None req-135d99ab-0d34-4be6-8db1-57e1d6ea5617 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] validate_networks() for [('bc78a282-f93c-447e-aeef-e773d7815fbd', None, None, None, None, None)] {{(pid=129470) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 18:02:06.083212 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-a2343e1f-efd4-4e8c-958e-249080101a58 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:06.084001 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-a2343e1f-efd4-4e8c-958e-249080101a58 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:06.091365 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a2343e1f-efd4-4e8c-958e-249080101a58 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:06.091820 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a2343e1f-efd4-4e8c-958e-249080101a58 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:06.093085 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a2343e1f-efd4-4e8c-958e-249080101a58 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:06.093756 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a2343e1f-efd4-4e8c-958e-249080101a58 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:06.206360 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-135d99ab-0d34-4be6-8db1-57e1d6ea5617 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Flavor limits 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 18:02:06.207868 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-135d99ab-0d34-4be6-8db1-57e1d6ea5617 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Image limits 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 18:02:06.209227 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-135d99ab-0d34-4be6-8db1-57e1d6ea5617 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Flavor pref 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 18:02:06.210134 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-135d99ab-0d34-4be6-8db1-57e1d6ea5617 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Image pref 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 18:02:06.211871 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-135d99ab-0d34-4be6-8db1-57e1d6ea5617 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 18:02:06.229823 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-135d99ab-0d34-4be6-8db1-57e1d6ea5617 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:06.230555 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-135d99ab-0d34-4be6-8db1-57e1d6ea5617 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:06.232513 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-135d99ab-0d34-4be6-8db1-57e1d6ea5617 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:06.233650 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-135d99ab-0d34-4be6-8db1-57e1d6ea5617 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:06.261708 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.quota [None req-135d99ab-0d34-4be6-8db1-57e1d6ea5617 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Getting quotas for project 73ce085523d84754b8d107b5c0936491. Resources: {'ram', 'cores', 'instances'} {{(pid=129470) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 18:02:06.266699 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.quota [None req-135d99ab-0d34-4be6-8db1-57e1d6ea5617 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Getting quotas for user d8dd1356e5bc4d35aca1bf1edf6f2140 and project 73ce085523d84754b8d107b5c0936491. Resources: {'ram', 'cores', 'instances'} {{(pid=129470) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 18:02:06.282297 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-135d99ab-0d34-4be6-8db1-57e1d6ea5617 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Going to run 1 instances... {{(pid=129470) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 18:02:06.285337 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-135d99ab-0d34-4be6-8db1-57e1d6ea5617 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: fc746cb3-bf0e-4f30-b58a-da488ca22206] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf1f5d8c-9e49-4272-8e19-8e3c587056e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129470) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 18:02:06.349798 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-135d99ab-0d34-4be6-8db1-57e1d6ea5617 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.930365 Jul 14 18:02:06.350821 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 457/958] 10.222.0.64 () {60 vars in 1146 bytes} [Thu Jul 14 18:02:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 18:02:06.377344 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-57db5f96-bdb9-4c8c-bbb7-0f391861d18b tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:06.377969 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-57db5f96-bdb9-4c8c-bbb7-0f391861d18b tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: fc746cb3-bf0e-4f30-b58a-da488ca22206] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:06.468258 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-57db5f96-bdb9-4c8c-bbb7-0f391861d18b tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dd1356e5bc4d35aca1bf1edf6f2140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ce085523d84754b8d107b5c0936491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:06.483779 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-57db5f96-bdb9-4c8c-bbb7-0f391861d18b tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "GET /compute/v2.1/servers/fc746cb3-bf0e-4f30-b58a-da488ca22206" status: 200 len: 1218 microversion: 2.1 time: 0.109751 Jul 14 18:02:06.484853 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 458/959] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:02:06 2022] GET /compute/v2.1/servers/fc746cb3-bf0e-4f30-b58a-da488ca22206 => generated 1218 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:02:06.492378 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-2bff36b9-a977-4ced-bfc9-4a7971646125 req-4d45ae79-e2b9-4cbb-9305-a12de6301fc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "509b127f-76cb-4358-84a9-457d4e0397ec", "name": "network-vif-plugged", "status": "completed", "tag": "ab754da5-453e-411a-a26f-b36d77ef6e13"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:02:06.519785 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-2bff36b9-a977-4ced-bfc9-4a7971646125 req-4d45ae79-e2b9-4cbb-9305-a12de6301fc0 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:06.520283 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-2bff36b9-a977-4ced-bfc9-4a7971646125 req-4d45ae79-e2b9-4cbb-9305-a12de6301fc0 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:06.539059 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-2bff36b9-a977-4ced-bfc9-4a7971646125 req-4d45ae79-e2b9-4cbb-9305-a12de6301fc0 service nova] Creating event network-vif-plugged:ab754da5-453e-411a-a26f-b36d77ef6e13 for instance 509b127f-76cb-4358-84a9-457d4e0397ec on hv-cinder-84989 Jul 14 18:02:06.550256 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-2bff36b9-a977-4ced-bfc9-4a7971646125 req-4d45ae79-e2b9-4cbb-9305-a12de6301fc0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062440 Jul 14 18:02:06.551791 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 459/960] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 18:02:06.574664 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-a2343e1f-efd4-4e8c-958e-249080101a58 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:06.584506 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-a2343e1f-efd4-4e8c-958e-249080101a58 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:06.586677 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-a2343e1f-efd4-4e8c-958e-249080101a58 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:06.588828 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-a2343e1f-efd4-4e8c-958e-249080101a58 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1747 microversion: 2.20 time: 0.509416 Jul 14 18:02:06.592829 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 502/961] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:06 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1747 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 18:02:07.504593 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-f03e177d-3708-4c52-b8cb-cb1d18180d27 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:07.505295 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-f03e177d-3708-4c52-b8cb-cb1d18180d27 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: fc746cb3-bf0e-4f30-b58a-da488ca22206] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:07.514030 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f03e177d-3708-4c52-b8cb-cb1d18180d27 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:07.514717 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f03e177d-3708-4c52-b8cb-cb1d18180d27 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:07.515510 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f03e177d-3708-4c52-b8cb-cb1d18180d27 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:07.516026 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f03e177d-3708-4c52-b8cb-cb1d18180d27 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:07.587913 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-f03e177d-3708-4c52-b8cb-cb1d18180d27 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dd1356e5bc4d35aca1bf1edf6f2140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ce085523d84754b8d107b5c0936491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:07.596737 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-f03e177d-3708-4c52-b8cb-cb1d18180d27 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "GET /compute/v2.1/servers/fc746cb3-bf0e-4f30-b58a-da488ca22206" status: 200 len: 1278 microversion: 2.1 time: 0.098608 Jul 14 18:02:07.597427 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 460/962] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:02:07 2022] GET /compute/v2.1/servers/fc746cb3-bf0e-4f30-b58a-da488ca22206 => generated 1278 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:02:07.613670 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-374dddb3-4913-41cf-b06c-ef1c59138b79 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:07.613670 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-374dddb3-4913-41cf-b06c-ef1c59138b79 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:07.621872 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-374dddb3-4913-41cf-b06c-ef1c59138b79 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:07.622480 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-374dddb3-4913-41cf-b06c-ef1c59138b79 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:07.623449 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-374dddb3-4913-41cf-b06c-ef1c59138b79 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:07.624183 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-374dddb3-4913-41cf-b06c-ef1c59138b79 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:07.799749 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-374dddb3-4913-41cf-b06c-ef1c59138b79 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:07.812083 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-374dddb3-4913-41cf-b06c-ef1c59138b79 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:07.814765 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-374dddb3-4913-41cf-b06c-ef1c59138b79 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:07.816299 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-374dddb3-4913-41cf-b06c-ef1c59138b79 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1747 microversion: 2.20 time: 0.207461 Jul 14 18:02:07.817256 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 503/963] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:07 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1747 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:02:08.619967 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-1dcd5bdc-25f5-4abb-8365-d11c81ce1ba2 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:08.621703 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-1dcd5bdc-25f5-4abb-8365-d11c81ce1ba2 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: fc746cb3-bf0e-4f30-b58a-da488ca22206] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:08.632572 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1dcd5bdc-25f5-4abb-8365-d11c81ce1ba2 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:08.634160 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1dcd5bdc-25f5-4abb-8365-d11c81ce1ba2 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:08.635801 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1dcd5bdc-25f5-4abb-8365-d11c81ce1ba2 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:08.637154 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1dcd5bdc-25f5-4abb-8365-d11c81ce1ba2 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:08.661634 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:02:08.836715 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-d2110d50-f897-41f2-b3e9-0ceb95746513 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:08.838560 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-d2110d50-f897-41f2-b3e9-0ceb95746513 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:08.845576 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d2110d50-f897-41f2-b3e9-0ceb95746513 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:08.846458 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d2110d50-f897-41f2-b3e9-0ceb95746513 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:08.847518 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d2110d50-f897-41f2-b3e9-0ceb95746513 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:08.848433 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d2110d50-f897-41f2-b3e9-0ceb95746513 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:08.875651 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-1dcd5bdc-25f5-4abb-8365-d11c81ce1ba2 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dd1356e5bc4d35aca1bf1edf6f2140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ce085523d84754b8d107b5c0936491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:08.877156 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:02:08.892931 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-1dcd5bdc-25f5-4abb-8365-d11c81ce1ba2 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "GET /compute/v2.1/servers/fc746cb3-bf0e-4f30-b58a-da488ca22206" status: 200 len: 1318 microversion: 2.1 time: 0.279721 Jul 14 18:02:08.894793 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 461/964] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:02:08 2022] GET /compute/v2.1/servers/fc746cb3-bf0e-4f30-b58a-da488ca22206 => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:02:09.164929 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-d2110d50-f897-41f2-b3e9-0ceb95746513 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:09.176858 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-d2110d50-f897-41f2-b3e9-0ceb95746513 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:09.178692 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-d2110d50-f897-41f2-b3e9-0ceb95746513 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:09.180093 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-d2110d50-f897-41f2-b3e9-0ceb95746513 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1747 microversion: 2.20 time: 0.348315 Jul 14 18:02:09.180912 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 504/965] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:08 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1747 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:02:09.821493 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-227d0619-3f88-4b93-a735-2540713bbc7b req-1b13d9ae-4c25-4634-9c46-ceca643f328d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc746cb3-bf0e-4f30-b58a-da488ca22206", "tag": "9b464089-2e21-4cde-a5ab-eae09e6e9d09"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:02:09.838928 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-227d0619-3f88-4b93-a735-2540713bbc7b req-1b13d9ae-4c25-4634-9c46-ceca643f328d service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:09.841692 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-227d0619-3f88-4b93-a735-2540713bbc7b req-1b13d9ae-4c25-4634-9c46-ceca643f328d service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:09.866140 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-227d0619-3f88-4b93-a735-2540713bbc7b req-1b13d9ae-4c25-4634-9c46-ceca643f328d service nova] Creating event network-changed:9b464089-2e21-4cde-a5ab-eae09e6e9d09 for instance fc746cb3-bf0e-4f30-b58a-da488ca22206 on hv-cinder-84989 Jul 14 18:02:09.873770 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-227d0619-3f88-4b93-a735-2540713bbc7b req-1b13d9ae-4c25-4634-9c46-ceca643f328d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057242 Jul 14 18:02:09.879133 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 462/966] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:02:09.912989 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-ee0f33d3-cd12-4731-83bf-16922fd6f72b tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:09.914616 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-ee0f33d3-cd12-4731-83bf-16922fd6f72b tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: fc746cb3-bf0e-4f30-b58a-da488ca22206] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:09.933294 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ee0f33d3-cd12-4731-83bf-16922fd6f72b tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:09.939696 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ee0f33d3-cd12-4731-83bf-16922fd6f72b tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:09.941008 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ee0f33d3-cd12-4731-83bf-16922fd6f72b tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:09.941733 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ee0f33d3-cd12-4731-83bf-16922fd6f72b tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:10.200717 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-b2c26daa-5160-415e-a083-963c2dbb463c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:10.202248 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-b2c26daa-5160-415e-a083-963c2dbb463c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:10.219485 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b2c26daa-5160-415e-a083-963c2dbb463c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:10.220257 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b2c26daa-5160-415e-a083-963c2dbb463c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:10.221284 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b2c26daa-5160-415e-a083-963c2dbb463c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:10.222095 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b2c26daa-5160-415e-a083-963c2dbb463c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:10.239225 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-ee0f33d3-cd12-4731-83bf-16922fd6f72b tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dd1356e5bc4d35aca1bf1edf6f2140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ce085523d84754b8d107b5c0936491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:10.259714 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-ee0f33d3-cd12-4731-83bf-16922fd6f72b tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "GET /compute/v2.1/servers/fc746cb3-bf0e-4f30-b58a-da488ca22206" status: 200 len: 1318 microversion: 2.1 time: 0.352509 Jul 14 18:02:10.262696 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 505/967] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:02:09 2022] GET /compute/v2.1/servers/fc746cb3-bf0e-4f30-b58a-da488ca22206 => generated 1318 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:02:10.553684 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-b2c26daa-5160-415e-a083-963c2dbb463c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:10.567098 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-b2c26daa-5160-415e-a083-963c2dbb463c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:10.570295 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-b2c26daa-5160-415e-a083-963c2dbb463c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:10.571852 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-b2c26daa-5160-415e-a083-963c2dbb463c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1742 microversion: 2.20 time: 0.375937 Jul 14 18:02:10.585511 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 463/968] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:10 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1742 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:02:11.284039 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-bd2afee5-c1db-4264-bb44-37edc7172681 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:11.285363 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-bd2afee5-c1db-4264-bb44-37edc7172681 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: fc746cb3-bf0e-4f30-b58a-da488ca22206] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:11.295793 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bd2afee5-c1db-4264-bb44-37edc7172681 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:11.296505 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bd2afee5-c1db-4264-bb44-37edc7172681 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:11.297543 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bd2afee5-c1db-4264-bb44-37edc7172681 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:11.298219 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bd2afee5-c1db-4264-bb44-37edc7172681 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:11.496056 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-bd2afee5-c1db-4264-bb44-37edc7172681 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dd1356e5bc4d35aca1bf1edf6f2140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ce085523d84754b8d107b5c0936491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:11.504957 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-bd2afee5-c1db-4264-bb44-37edc7172681 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "GET /compute/v2.1/servers/fc746cb3-bf0e-4f30-b58a-da488ca22206" status: 200 len: 1318 microversion: 2.1 time: 0.228108 Jul 14 18:02:11.507747 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 506/969] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:02:11 2022] GET /compute/v2.1/servers/fc746cb3-bf0e-4f30-b58a-da488ca22206 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:02:11.601352 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-88f02938-c275-41f0-8e79-2865a1d60673 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:11.603853 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-88f02938-c275-41f0-8e79-2865a1d60673 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:11.624844 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-88f02938-c275-41f0-8e79-2865a1d60673 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:11.626328 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-88f02938-c275-41f0-8e79-2865a1d60673 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:11.629235 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-88f02938-c275-41f0-8e79-2865a1d60673 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:11.632171 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-88f02938-c275-41f0-8e79-2865a1d60673 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:11.904484 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-88f02938-c275-41f0-8e79-2865a1d60673 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:11.916351 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-88f02938-c275-41f0-8e79-2865a1d60673 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:11.918653 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-88f02938-c275-41f0-8e79-2865a1d60673 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:11.920312 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-88f02938-c275-41f0-8e79-2865a1d60673 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1742 microversion: 2.20 time: 0.329261 Jul 14 18:02:11.921128 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 464/970] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:11 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1742 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:02:12.532192 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-066baa5c-e3b4-4bdc-b9a4-2218ee5996e0 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:12.533496 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-066baa5c-e3b4-4bdc-b9a4-2218ee5996e0 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: fc746cb3-bf0e-4f30-b58a-da488ca22206] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:12.541016 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-066baa5c-e3b4-4bdc-b9a4-2218ee5996e0 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:12.541474 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-066baa5c-e3b4-4bdc-b9a4-2218ee5996e0 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:12.542475 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-066baa5c-e3b4-4bdc-b9a4-2218ee5996e0 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:12.542930 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-066baa5c-e3b4-4bdc-b9a4-2218ee5996e0 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:12.723141 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-066baa5c-e3b4-4bdc-b9a4-2218ee5996e0 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dd1356e5bc4d35aca1bf1edf6f2140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ce085523d84754b8d107b5c0936491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:12.732331 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-066baa5c-e3b4-4bdc-b9a4-2218ee5996e0 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "GET /compute/v2.1/servers/fc746cb3-bf0e-4f30-b58a-da488ca22206" status: 200 len: 1318 microversion: 2.1 time: 0.204339 Jul 14 18:02:12.733337 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 507/971] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:02:12 2022] GET /compute/v2.1/servers/fc746cb3-bf0e-4f30-b58a-da488ca22206 => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 18:02:12.956965 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-35f45a4d-1e6b-4c44-b57a-c59d8a6c4cb4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:12.958318 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-35f45a4d-1e6b-4c44-b57a-c59d8a6c4cb4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:12.965813 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-35f45a4d-1e6b-4c44-b57a-c59d8a6c4cb4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:12.966605 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-35f45a4d-1e6b-4c44-b57a-c59d8a6c4cb4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:12.967672 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-35f45a4d-1e6b-4c44-b57a-c59d8a6c4cb4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:12.968373 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-35f45a4d-1e6b-4c44-b57a-c59d8a6c4cb4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:13.153904 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-35f45a4d-1e6b-4c44-b57a-c59d8a6c4cb4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:13.166569 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-35f45a4d-1e6b-4c44-b57a-c59d8a6c4cb4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:13.168345 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-35f45a4d-1e6b-4c44-b57a-c59d8a6c4cb4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:13.169882 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-35f45a4d-1e6b-4c44-b57a-c59d8a6c4cb4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1742 microversion: 2.20 time: 0.217875 Jul 14 18:02:13.170468 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 465/972] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:12 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1742 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:02:13.757799 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-dad6f048-82d8-4ac1-b23e-8b6f5fabc6b9 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:13.759740 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-dad6f048-82d8-4ac1-b23e-8b6f5fabc6b9 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: fc746cb3-bf0e-4f30-b58a-da488ca22206] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:13.772203 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:02:13.775662 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-dad6f048-82d8-4ac1-b23e-8b6f5fabc6b9 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:13.776910 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-dad6f048-82d8-4ac1-b23e-8b6f5fabc6b9 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:13.778648 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-dad6f048-82d8-4ac1-b23e-8b6f5fabc6b9 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:13.779721 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-dad6f048-82d8-4ac1-b23e-8b6f5fabc6b9 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:14.056360 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-dad6f048-82d8-4ac1-b23e-8b6f5fabc6b9 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dd1356e5bc4d35aca1bf1edf6f2140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ce085523d84754b8d107b5c0936491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:14.064530 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-dad6f048-82d8-4ac1-b23e-8b6f5fabc6b9 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "GET /compute/v2.1/servers/fc746cb3-bf0e-4f30-b58a-da488ca22206" status: 200 len: 1318 microversion: 2.1 time: 0.316928 Jul 14 18:02:14.078490 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 508/973] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:02:13 2022] GET /compute/v2.1/servers/fc746cb3-bf0e-4f30-b58a-da488ca22206 => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 18:02:14.198267 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-e254616e-265e-46f4-ae88-30aef172ca43 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:14.198888 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-e254616e-265e-46f4-ae88-30aef172ca43 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:14.206174 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e254616e-265e-46f4-ae88-30aef172ca43 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:14.207323 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e254616e-265e-46f4-ae88-30aef172ca43 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:14.208237 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e254616e-265e-46f4-ae88-30aef172ca43 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:14.208748 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e254616e-265e-46f4-ae88-30aef172ca43 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:14.378141 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-e254616e-265e-46f4-ae88-30aef172ca43 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:14.388963 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-e254616e-265e-46f4-ae88-30aef172ca43 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:14.391130 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-e254616e-265e-46f4-ae88-30aef172ca43 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:14.392690 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-e254616e-265e-46f4-ae88-30aef172ca43 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1742 microversion: 2.20 time: 0.201155 Jul 14 18:02:14.405848 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 466/974] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:14 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1742 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 18:02:15.086972 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-d410a40b-197d-46f4-abc2-278c8d37061b tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:15.090362 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-d410a40b-197d-46f4-abc2-278c8d37061b tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: fc746cb3-bf0e-4f30-b58a-da488ca22206] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:15.109303 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d410a40b-197d-46f4-abc2-278c8d37061b tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:15.111078 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d410a40b-197d-46f4-abc2-278c8d37061b tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:15.113074 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d410a40b-197d-46f4-abc2-278c8d37061b tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:15.114341 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d410a40b-197d-46f4-abc2-278c8d37061b tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:15.383085 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-d410a40b-197d-46f4-abc2-278c8d37061b tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dd1356e5bc4d35aca1bf1edf6f2140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ce085523d84754b8d107b5c0936491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:15.401570 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-d410a40b-197d-46f4-abc2-278c8d37061b tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "GET /compute/v2.1/servers/fc746cb3-bf0e-4f30-b58a-da488ca22206" status: 200 len: 1318 microversion: 2.1 time: 0.322275 Jul 14 18:02:15.403441 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 509/975] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:02:15 2022] GET /compute/v2.1/servers/fc746cb3-bf0e-4f30-b58a-da488ca22206 => generated 1318 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:02:15.429234 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-39582202-d4a5-4083-a533-dea11279b3ca tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:15.432543 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-39582202-d4a5-4083-a533-dea11279b3ca tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:15.438164 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:02:15.451628 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-39582202-d4a5-4083-a533-dea11279b3ca tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:15.452489 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-39582202-d4a5-4083-a533-dea11279b3ca tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:15.453953 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-39582202-d4a5-4083-a533-dea11279b3ca tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:15.454712 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-39582202-d4a5-4083-a533-dea11279b3ca tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:15.664288 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-39582202-d4a5-4083-a533-dea11279b3ca tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:15.680583 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-39582202-d4a5-4083-a533-dea11279b3ca tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:15.686558 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-39582202-d4a5-4083-a533-dea11279b3ca tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:15.689216 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-39582202-d4a5-4083-a533-dea11279b3ca tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1742 microversion: 2.20 time: 0.268147 Jul 14 18:02:15.690859 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 467/976] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:15 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1742 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:02:16.435523 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-c379366e-84c4-498a-b3cf-8e6145957c63 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:16.436686 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-c379366e-84c4-498a-b3cf-8e6145957c63 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: fc746cb3-bf0e-4f30-b58a-da488ca22206] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:16.450604 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c379366e-84c4-498a-b3cf-8e6145957c63 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:16.451401 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c379366e-84c4-498a-b3cf-8e6145957c63 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:16.452916 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c379366e-84c4-498a-b3cf-8e6145957c63 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:16.453710 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c379366e-84c4-498a-b3cf-8e6145957c63 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:16.642753 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-9b65e33d-2498-4229-8b59-962558d91696 req-21b225b5-09eb-4b41-886b-1cc926c5e6cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc746cb3-bf0e-4f30-b58a-da488ca22206", "name": "network-vif-plugged", "status": "completed", "tag": "9b464089-2e21-4cde-a5ab-eae09e6e9d09"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:02:16.652338 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell0:SELECT=2 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:02:16.654029 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell0:SELECT=8 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:02:16.654601 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-c379366e-84c4-498a-b3cf-8e6145957c63 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dd1356e5bc4d35aca1bf1edf6f2140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ce085523d84754b8d107b5c0936491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:16.660175 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-9b65e33d-2498-4229-8b59-962558d91696 req-21b225b5-09eb-4b41-886b-1cc926c5e6cf service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:16.660175 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-9b65e33d-2498-4229-8b59-962558d91696 req-21b225b5-09eb-4b41-886b-1cc926c5e6cf service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:16.674706 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-9b65e33d-2498-4229-8b59-962558d91696 req-21b225b5-09eb-4b41-886b-1cc926c5e6cf service nova] Creating event network-vif-plugged:9b464089-2e21-4cde-a5ab-eae09e6e9d09 for instance fc746cb3-bf0e-4f30-b58a-da488ca22206 on hv-cinder-84989 Jul 14 18:02:16.682014 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-9b65e33d-2498-4229-8b59-962558d91696 req-21b225b5-09eb-4b41-886b-1cc926c5e6cf service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044024 Jul 14 18:02:16.683289 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 468/977] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 18:02:16.694071 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-c379366e-84c4-498a-b3cf-8e6145957c63 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "GET /compute/v2.1/servers/fc746cb3-bf0e-4f30-b58a-da488ca22206" status: 200 len: 1318 microversion: 2.1 time: 0.262552 Jul 14 18:02:16.695188 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 510/978] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:02:16 2022] GET /compute/v2.1/servers/fc746cb3-bf0e-4f30-b58a-da488ca22206 => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:02:16.717662 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-c7644389-d21b-4a7b-8286-9184b2aae582 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:16.719146 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-c7644389-d21b-4a7b-8286-9184b2aae582 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:16.728388 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c7644389-d21b-4a7b-8286-9184b2aae582 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:16.729293 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c7644389-d21b-4a7b-8286-9184b2aae582 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:16.730826 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c7644389-d21b-4a7b-8286-9184b2aae582 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:16.730826 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c7644389-d21b-4a7b-8286-9184b2aae582 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:17.076826 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-c7644389-d21b-4a7b-8286-9184b2aae582 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:17.093231 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-c7644389-d21b-4a7b-8286-9184b2aae582 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:17.095645 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-c7644389-d21b-4a7b-8286-9184b2aae582 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:17.097182 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-c7644389-d21b-4a7b-8286-9184b2aae582 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1742 microversion: 2.20 time: 0.389253 Jul 14 18:02:17.108564 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 469/979] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:16 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1742 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 18:02:17.733989 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-723c33ec-3713-4c31-bf8b-35586782897a tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:17.736141 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-723c33ec-3713-4c31-bf8b-35586782897a tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: fc746cb3-bf0e-4f30-b58a-da488ca22206] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:17.748123 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-723c33ec-3713-4c31-bf8b-35586782897a tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:17.748960 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-723c33ec-3713-4c31-bf8b-35586782897a tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:17.750069 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-723c33ec-3713-4c31-bf8b-35586782897a tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:17.750838 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-723c33ec-3713-4c31-bf8b-35586782897a tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:17.941626 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-723c33ec-3713-4c31-bf8b-35586782897a tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dd1356e5bc4d35aca1bf1edf6f2140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ce085523d84754b8d107b5c0936491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:17.950586 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-723c33ec-3713-4c31-bf8b-35586782897a tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "GET /compute/v2.1/servers/fc746cb3-bf0e-4f30-b58a-da488ca22206" status: 200 len: 1318 microversion: 2.1 time: 0.220533 Jul 14 18:02:17.960922 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 511/980] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:02:17 2022] GET /compute/v2.1/servers/fc746cb3-bf0e-4f30-b58a-da488ca22206 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:02:18.130135 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-8558efc1-cec8-48f2-9d73-8185fd9ba773 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:18.131415 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-8558efc1-cec8-48f2-9d73-8185fd9ba773 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:18.144302 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8558efc1-cec8-48f2-9d73-8185fd9ba773 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:18.145509 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8558efc1-cec8-48f2-9d73-8185fd9ba773 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:18.147350 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8558efc1-cec8-48f2-9d73-8185fd9ba773 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:18.148082 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8558efc1-cec8-48f2-9d73-8185fd9ba773 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:18.349392 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-8558efc1-cec8-48f2-9d73-8185fd9ba773 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:18.363645 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-8558efc1-cec8-48f2-9d73-8185fd9ba773 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:18.366656 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-8558efc1-cec8-48f2-9d73-8185fd9ba773 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:18.368900 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-8558efc1-cec8-48f2-9d73-8185fd9ba773 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1742 microversion: 2.20 time: 0.255083 Jul 14 18:02:18.370736 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 470/981] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:18 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1742 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 18:02:18.973183 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-0550042d-f1d0-4160-a419-784554338cd6 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:18.974332 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-0550042d-f1d0-4160-a419-784554338cd6 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: fc746cb3-bf0e-4f30-b58a-da488ca22206] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:18.986927 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0550042d-f1d0-4160-a419-784554338cd6 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:18.988144 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0550042d-f1d0-4160-a419-784554338cd6 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:18.989797 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0550042d-f1d0-4160-a419-784554338cd6 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:18.990884 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0550042d-f1d0-4160-a419-784554338cd6 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:19.181325 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-0550042d-f1d0-4160-a419-784554338cd6 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dd1356e5bc4d35aca1bf1edf6f2140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ce085523d84754b8d107b5c0936491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:19.190170 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-0550042d-f1d0-4160-a419-784554338cd6 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "GET /compute/v2.1/servers/fc746cb3-bf0e-4f30-b58a-da488ca22206" status: 200 len: 1318 microversion: 2.1 time: 0.225220 Jul 14 18:02:19.190961 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 512/982] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:02:18 2022] GET /compute/v2.1/servers/fc746cb3-bf0e-4f30-b58a-da488ca22206 => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:02:19.389555 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-2d93715c-b821-42d6-9f20-61dc8b7a9314 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:19.391190 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-2d93715c-b821-42d6-9f20-61dc8b7a9314 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:19.402609 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2d93715c-b821-42d6-9f20-61dc8b7a9314 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:19.403445 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2d93715c-b821-42d6-9f20-61dc8b7a9314 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:19.404421 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2d93715c-b821-42d6-9f20-61dc8b7a9314 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:19.405039 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-2d93715c-b821-42d6-9f20-61dc8b7a9314 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:19.603596 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-2d93715c-b821-42d6-9f20-61dc8b7a9314 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:19.612993 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-2d93715c-b821-42d6-9f20-61dc8b7a9314 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:19.614810 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-2d93715c-b821-42d6-9f20-61dc8b7a9314 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:19.616124 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-2d93715c-b821-42d6-9f20-61dc8b7a9314 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1742 microversion: 2.20 time: 0.230640 Jul 14 18:02:19.616976 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 471/983] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:19 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1742 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:02:20.207220 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-e9faf255-82fd-4fd0-8565-29aa4d3563ff tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:20.207836 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-e9faf255-82fd-4fd0-8565-29aa4d3563ff tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: fc746cb3-bf0e-4f30-b58a-da488ca22206] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:20.215136 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e9faf255-82fd-4fd0-8565-29aa4d3563ff tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:20.216009 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e9faf255-82fd-4fd0-8565-29aa4d3563ff tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:20.217012 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e9faf255-82fd-4fd0-8565-29aa4d3563ff tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:20.217453 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e9faf255-82fd-4fd0-8565-29aa4d3563ff tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:20.376999 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-e9faf255-82fd-4fd0-8565-29aa4d3563ff tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dd1356e5bc4d35aca1bf1edf6f2140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ce085523d84754b8d107b5c0936491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:20.385370 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-e9faf255-82fd-4fd0-8565-29aa4d3563ff tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "GET /compute/v2.1/servers/fc746cb3-bf0e-4f30-b58a-da488ca22206" status: 200 len: 1507 microversion: 2.1 time: 0.182405 Jul 14 18:02:20.385889 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 513/984] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:02:20 2022] GET /compute/v2.1/servers/fc746cb3-bf0e-4f30-b58a-da488ca22206 => generated 1507 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:02:20.635771 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-ddb7e9ee-5202-4c20-aa37-413d0ed89010 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:20.636600 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-ddb7e9ee-5202-4c20-aa37-413d0ed89010 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:20.643074 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ddb7e9ee-5202-4c20-aa37-413d0ed89010 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:20.643560 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ddb7e9ee-5202-4c20-aa37-413d0ed89010 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:20.644474 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ddb7e9ee-5202-4c20-aa37-413d0ed89010 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:20.644914 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ddb7e9ee-5202-4c20-aa37-413d0ed89010 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:20.805957 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-ddb7e9ee-5202-4c20-aa37-413d0ed89010 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:20.814307 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-ddb7e9ee-5202-4c20-aa37-413d0ed89010 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:20.816112 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-ddb7e9ee-5202-4c20-aa37-413d0ed89010 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:20.817882 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-ddb7e9ee-5202-4c20-aa37-413d0ed89010 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1742 microversion: 2.20 time: 0.186425 Jul 14 18:02:20.818720 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 472/985] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:20 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1742 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:02:21.836543 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-fdb26506-31a8-4140-94f3-ee245e7717bd tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:21.837271 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-fdb26506-31a8-4140-94f3-ee245e7717bd tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:21.845000 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fdb26506-31a8-4140-94f3-ee245e7717bd tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:21.845456 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fdb26506-31a8-4140-94f3-ee245e7717bd tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:21.846282 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fdb26506-31a8-4140-94f3-ee245e7717bd tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:21.847020 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fdb26506-31a8-4140-94f3-ee245e7717bd tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:22.011742 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-fdb26506-31a8-4140-94f3-ee245e7717bd tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:22.024653 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-fdb26506-31a8-4140-94f3-ee245e7717bd tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:22.026249 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-fdb26506-31a8-4140-94f3-ee245e7717bd tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:22.027544 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-fdb26506-31a8-4140-94f3-ee245e7717bd tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1724 microversion: 2.20 time: 0.195656 Jul 14 18:02:22.028165 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 514/986] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:21 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:02:23.048015 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-84643bed-ef25-4f01-b824-650549fdd8e3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:23.048730 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-84643bed-ef25-4f01-b824-650549fdd8e3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:23.056610 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-84643bed-ef25-4f01-b824-650549fdd8e3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:23.057065 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-84643bed-ef25-4f01-b824-650549fdd8e3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:23.057985 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-84643bed-ef25-4f01-b824-650549fdd8e3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:23.058439 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-84643bed-ef25-4f01-b824-650549fdd8e3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:23.222625 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-84643bed-ef25-4f01-b824-650549fdd8e3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:23.230871 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-84643bed-ef25-4f01-b824-650549fdd8e3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:23.232449 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-84643bed-ef25-4f01-b824-650549fdd8e3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:23.233611 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-84643bed-ef25-4f01-b824-650549fdd8e3 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1724 microversion: 2.20 time: 0.190306 Jul 14 18:02:23.234160 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 473/987] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:23 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 18:02:24.254024 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-950e331b-819d-4a98-b097-a35f2a9571c7 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:24.254590 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-950e331b-819d-4a98-b097-a35f2a9571c7 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:24.261411 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-950e331b-819d-4a98-b097-a35f2a9571c7 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:24.261906 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-950e331b-819d-4a98-b097-a35f2a9571c7 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:24.262693 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-950e331b-819d-4a98-b097-a35f2a9571c7 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:24.263172 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-950e331b-819d-4a98-b097-a35f2a9571c7 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:24.405988 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-950e331b-819d-4a98-b097-a35f2a9571c7 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:24.414557 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-950e331b-819d-4a98-b097-a35f2a9571c7 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:24.416029 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-950e331b-819d-4a98-b097-a35f2a9571c7 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:24.417386 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-950e331b-819d-4a98-b097-a35f2a9571c7 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1727 microversion: 2.20 time: 0.167958 Jul 14 18:02:24.417855 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 515/988] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:24 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:02:24.437284 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-3877de06-ba49-4ec3-b7d8-47e583af3e21 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "454a3ce0-878e-4896-b0fe-9bdb733bf3d3"}} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:02:24.438759 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-3877de06-ba49-4ec3-b7d8-47e583af3e21 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:24.447697 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3877de06-ba49-4ec3-b7d8-47e583af3e21 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:24.448179 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3877de06-ba49-4ec3-b7d8-47e583af3e21 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:24.448975 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3877de06-ba49-4ec3-b7d8-47e583af3e21 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:24.449423 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3877de06-ba49-4ec3-b7d8-47e583af3e21 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:24.599872 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [req-3e6f1802-d079-4f97-9517-78d28716cb18 req-5fd22d22-cf82-4985-829f-be41e8b8c5e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "509b127f-76cb-4358-84a9-457d4e0397ec", "name": "network-vif-unplugged", "status": "completed", "tag": "ab754da5-453e-411a-a26f-b36d77ef6e13"}]} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:02:24.614024 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-3e6f1802-d079-4f97-9517-78d28716cb18 req-5fd22d22-cf82-4985-829f-be41e8b8c5e4 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:24.614540 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-3e6f1802-d079-4f97-9517-78d28716cb18 req-5fd22d22-cf82-4985-829f-be41e8b8c5e4 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:24.632535 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.compute.server_external_events [req-3e6f1802-d079-4f97-9517-78d28716cb18 req-5fd22d22-cf82-4985-829f-be41e8b8c5e4 service nova] Unable to find a host for instance 509b127f-76cb-4358-84a9-457d4e0397ec. Dropping event network-vif-unplugged {{(pid=129471) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 14 18:02:24.633646 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [req-3e6f1802-d079-4f97-9517-78d28716cb18 req-5fd22d22-cf82-4985-829f-be41e8b8c5e4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.045919 Jul 14 18:02:24.634263 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 516/989] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 48 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 14 18:02:24.832542 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-3877de06-ba49-4ec3-b7d8-47e583af3e21 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "POST /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.400600 Jul 14 18:02:24.833203 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 474/990] 10.222.0.64 () {62 vars in 1363 bytes} [Thu Jul 14 18:02:24 2022] POST /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec/os-volume_attachments => generated 188 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 18:02:24.973002 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-7451acdf-96d2-4066-bb4e-723fcf70d02d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:24.973505 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-7451acdf-96d2-4066-bb4e-723fcf70d02d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:24.980189 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7451acdf-96d2-4066-bb4e-723fcf70d02d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:24.980646 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7451acdf-96d2-4066-bb4e-723fcf70d02d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:24.981438 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7451acdf-96d2-4066-bb4e-723fcf70d02d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:24.981883 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7451acdf-96d2-4066-bb4e-723fcf70d02d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:25.261844 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-7451acdf-96d2-4066-bb4e-723fcf70d02d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "DELETE /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec/os-volume_attachments/454a3ce0-878e-4896-b0fe-9bdb733bf3d3" status: 202 len: 0 microversion: 2.20 time: 0.292789 Jul 14 18:02:25.262537 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 517/991] 10.222.0.64 () {60 vars in 1456 bytes} [Thu Jul 14 18:02:24 2022] DELETE /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec/os-volume_attachments/454a3ce0-878e-4896-b0fe-9bdb733bf3d3 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 14 18:02:25.322891 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-ab1fee58-93e3-4d88-a4fa-2dc0c663e90b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:02:25.323461 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-ab1fee58-93e3-4d88-a4fa-2dc0c663e90b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:25.331077 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ab1fee58-93e3-4d88-a4fa-2dc0c663e90b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:25.331538 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ab1fee58-93e3-4d88-a4fa-2dc0c663e90b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:25.332383 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ab1fee58-93e3-4d88-a4fa-2dc0c663e90b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:25.332824 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ab1fee58-93e3-4d88-a4fa-2dc0c663e90b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:25.398369 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:02:25.414533 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-ab1fee58-93e3-4d88-a4fa-2dc0c663e90b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "POST /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec/action" status: 202 len: 0 microversion: 2.20 time: 0.095519 Jul 14 18:02:25.415081 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 475/992] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Jul 14 18:02:25 2022] POST /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 18:02:25.424518 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-bb755c7b-25d9-42fe-a334-2385ce4529af tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:25.425228 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-bb755c7b-25d9-42fe-a334-2385ce4529af tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:25.432855 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bb755c7b-25d9-42fe-a334-2385ce4529af tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:25.433776 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bb755c7b-25d9-42fe-a334-2385ce4529af tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:25.435286 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bb755c7b-25d9-42fe-a334-2385ce4529af tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:25.435826 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-bb755c7b-25d9-42fe-a334-2385ce4529af tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:25.582120 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-bb755c7b-25d9-42fe-a334-2385ce4529af tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:25.591139 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-bb755c7b-25d9-42fe-a334-2385ce4529af tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:25.598526 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-bb755c7b-25d9-42fe-a334-2385ce4529af tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:25.599814 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-bb755c7b-25d9-42fe-a334-2385ce4529af tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1675 microversion: 2.20 time: 0.180222 Jul 14 18:02:25.600495 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 518/993] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:25 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1675 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:02:26.619571 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-8cb80221-4604-4395-be15-c780cf55a140 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:26.620231 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-8cb80221-4604-4395-be15-c780cf55a140 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:26.627562 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8cb80221-4604-4395-be15-c780cf55a140 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:26.628043 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8cb80221-4604-4395-be15-c780cf55a140 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:26.628821 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8cb80221-4604-4395-be15-c780cf55a140 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:26.629266 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8cb80221-4604-4395-be15-c780cf55a140 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:26.767501 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-8cb80221-4604-4395-be15-c780cf55a140 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:26.776169 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-8cb80221-4604-4395-be15-c780cf55a140 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:26.777707 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-8cb80221-4604-4395-be15-c780cf55a140 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:26.778890 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-8cb80221-4604-4395-be15-c780cf55a140 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1677 microversion: 2.20 time: 0.164202 Jul 14 18:02:26.779454 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 476/994] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:26 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:02:27.798927 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-108ba6d6-0874-4595-a91f-fd46244e753d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:27.799532 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-108ba6d6-0874-4595-a91f-fd46244e753d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:27.806143 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-108ba6d6-0874-4595-a91f-fd46244e753d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:27.806588 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-108ba6d6-0874-4595-a91f-fd46244e753d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:27.807357 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-108ba6d6-0874-4595-a91f-fd46244e753d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:27.807796 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-108ba6d6-0874-4595-a91f-fd46244e753d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:27.811956 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:02:27.958710 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-108ba6d6-0874-4595-a91f-fd46244e753d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:27.970406 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-108ba6d6-0874-4595-a91f-fd46244e753d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:27.972302 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-108ba6d6-0874-4595-a91f-fd46244e753d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:27.973744 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-108ba6d6-0874-4595-a91f-fd46244e753d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1733 microversion: 2.20 time: 0.178693 Jul 14 18:02:27.974522 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 519/995] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:27 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1733 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:02:28.992044 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-6fb20b38-6d06-4852-b8ff-242ad156b6f8 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:28.992872 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-6fb20b38-6d06-4852-b8ff-242ad156b6f8 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:29.001215 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6fb20b38-6d06-4852-b8ff-242ad156b6f8 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:29.001690 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6fb20b38-6d06-4852-b8ff-242ad156b6f8 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:29.002771 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6fb20b38-6d06-4852-b8ff-242ad156b6f8 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:29.003220 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6fb20b38-6d06-4852-b8ff-242ad156b6f8 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:29.142197 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-6fb20b38-6d06-4852-b8ff-242ad156b6f8 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:29.150576 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-6fb20b38-6d06-4852-b8ff-242ad156b6f8 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:29.152673 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-6fb20b38-6d06-4852-b8ff-242ad156b6f8 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:29.153832 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-6fb20b38-6d06-4852-b8ff-242ad156b6f8 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1733 microversion: 2.20 time: 0.165940 Jul 14 18:02:29.154402 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 477/996] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:28 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1733 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:02:30.173822 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-405a1a16-0c78-4df8-84e6-460f5183d7c2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:30.174619 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-405a1a16-0c78-4df8-84e6-460f5183d7c2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:30.182014 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-405a1a16-0c78-4df8-84e6-460f5183d7c2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:30.183063 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-405a1a16-0c78-4df8-84e6-460f5183d7c2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:30.183872 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-405a1a16-0c78-4df8-84e6-460f5183d7c2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:30.184343 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-405a1a16-0c78-4df8-84e6-460f5183d7c2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:30.376298 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-405a1a16-0c78-4df8-84e6-460f5183d7c2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:30.385348 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-405a1a16-0c78-4df8-84e6-460f5183d7c2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:30.387374 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-405a1a16-0c78-4df8-84e6-460f5183d7c2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:30.388913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-405a1a16-0c78-4df8-84e6-460f5183d7c2 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1733 microversion: 2.20 time: 0.219362 Jul 14 18:02:30.389685 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 520/997] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:30 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1733 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 18:02:31.408185 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-b7ef7202-fb23-4c3a-aa2d-64c9550394ff tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:31.408805 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-b7ef7202-fb23-4c3a-aa2d-64c9550394ff tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:31.418854 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b7ef7202-fb23-4c3a-aa2d-64c9550394ff tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:31.419872 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b7ef7202-fb23-4c3a-aa2d-64c9550394ff tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:31.422538 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b7ef7202-fb23-4c3a-aa2d-64c9550394ff tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:31.424437 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b7ef7202-fb23-4c3a-aa2d-64c9550394ff tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:31.583251 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-b7ef7202-fb23-4c3a-aa2d-64c9550394ff tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:31.592713 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-b7ef7202-fb23-4c3a-aa2d-64c9550394ff tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:31.594255 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-b7ef7202-fb23-4c3a-aa2d-64c9550394ff tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:31.595512 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-b7ef7202-fb23-4c3a-aa2d-64c9550394ff tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1733 microversion: 2.20 time: 0.192325 Jul 14 18:02:31.596209 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 478/998] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:31 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1733 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:02:32.614953 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-92b83d6d-c253-45d0-8b86-a82576fd2b1b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:32.615712 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-92b83d6d-c253-45d0-8b86-a82576fd2b1b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:32.622224 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-92b83d6d-c253-45d0-8b86-a82576fd2b1b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:32.622671 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-92b83d6d-c253-45d0-8b86-a82576fd2b1b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:32.624486 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-92b83d6d-c253-45d0-8b86-a82576fd2b1b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:32.625211 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-92b83d6d-c253-45d0-8b86-a82576fd2b1b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:32.775115 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-92b83d6d-c253-45d0-8b86-a82576fd2b1b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:32.784452 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-92b83d6d-c253-45d0-8b86-a82576fd2b1b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:32.786679 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-92b83d6d-c253-45d0-8b86-a82576fd2b1b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:32.787497 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-92b83d6d-c253-45d0-8b86-a82576fd2b1b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1733 microversion: 2.20 time: 0.176507 Jul 14 18:02:32.788242 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 521/999] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:32 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1733 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:02:33.808556 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-68130a1a-d05b-4bf6-ae5f-531e2f0805a7 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:33.809104 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-68130a1a-d05b-4bf6-ae5f-531e2f0805a7 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:33.815674 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-68130a1a-d05b-4bf6-ae5f-531e2f0805a7 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:33.816239 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-68130a1a-d05b-4bf6-ae5f-531e2f0805a7 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:33.817020 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-68130a1a-d05b-4bf6-ae5f-531e2f0805a7 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:33.817463 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-68130a1a-d05b-4bf6-ae5f-531e2f0805a7 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:33.955264 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-68130a1a-d05b-4bf6-ae5f-531e2f0805a7 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:33.964037 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-68130a1a-d05b-4bf6-ae5f-531e2f0805a7 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:33.965568 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-68130a1a-d05b-4bf6-ae5f-531e2f0805a7 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:33.966836 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-68130a1a-d05b-4bf6-ae5f-531e2f0805a7 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1733 microversion: 2.20 time: 0.164429 Jul 14 18:02:33.967382 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 479/1000] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:33 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:02:34.984863 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-c002bc94-6c57-46c3-897d-d188f707c636 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:34.985884 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-c002bc94-6c57-46c3-897d-d188f707c636 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:34.993359 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c002bc94-6c57-46c3-897d-d188f707c636 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:34.993904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c002bc94-6c57-46c3-897d-d188f707c636 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:34.994760 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c002bc94-6c57-46c3-897d-d188f707c636 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:34.995298 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c002bc94-6c57-46c3-897d-d188f707c636 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:35.139012 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-c002bc94-6c57-46c3-897d-d188f707c636 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:35.147643 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-c002bc94-6c57-46c3-897d-d188f707c636 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:35.149731 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-c002bc94-6c57-46c3-897d-d188f707c636 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:35.150906 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-c002bc94-6c57-46c3-897d-d188f707c636 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1733 microversion: 2.20 time: 0.170054 Jul 14 18:02:35.151464 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 522/1001] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:34 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1733 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:02:36.169387 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-79e12d22-8c0f-4ab5-823a-d5a899c6781d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:36.169992 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-79e12d22-8c0f-4ab5-823a-d5a899c6781d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:36.176797 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-79e12d22-8c0f-4ab5-823a-d5a899c6781d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:36.177252 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-79e12d22-8c0f-4ab5-823a-d5a899c6781d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:36.178155 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-79e12d22-8c0f-4ab5-823a-d5a899c6781d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:36.178635 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-79e12d22-8c0f-4ab5-823a-d5a899c6781d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:36.318730 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-79e12d22-8c0f-4ab5-823a-d5a899c6781d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:36.327960 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-79e12d22-8c0f-4ab5-823a-d5a899c6781d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:36.329490 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-79e12d22-8c0f-4ab5-823a-d5a899c6781d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:36.330719 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-79e12d22-8c0f-4ab5-823a-d5a899c6781d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1733 microversion: 2.20 time: 0.165220 Jul 14 18:02:36.331280 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 480/1002] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:36 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 18:02:37.349215 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-b9d8b144-35bf-4db4-9cc8-af9cafd9e49f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:37.349814 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-b9d8b144-35bf-4db4-9cc8-af9cafd9e49f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:37.358199 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b9d8b144-35bf-4db4-9cc8-af9cafd9e49f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:37.358797 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b9d8b144-35bf-4db4-9cc8-af9cafd9e49f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:37.359738 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b9d8b144-35bf-4db4-9cc8-af9cafd9e49f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:37.360420 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b9d8b144-35bf-4db4-9cc8-af9cafd9e49f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:37.516265 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-b9d8b144-35bf-4db4-9cc8-af9cafd9e49f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:37.545417 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-b9d8b144-35bf-4db4-9cc8-af9cafd9e49f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:37.546890 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-b9d8b144-35bf-4db4-9cc8-af9cafd9e49f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:37.548162 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-b9d8b144-35bf-4db4-9cc8-af9cafd9e49f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1733 microversion: 2.20 time: 0.202832 Jul 14 18:02:37.558185 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 523/1003] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:37 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1733 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:02:38.569251 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-dbc5391c-a130-4883-98a1-1c141e785c61 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:38.569861 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-dbc5391c-a130-4883-98a1-1c141e785c61 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:38.576186 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-dbc5391c-a130-4883-98a1-1c141e785c61 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:38.576638 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-dbc5391c-a130-4883-98a1-1c141e785c61 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:38.577416 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-dbc5391c-a130-4883-98a1-1c141e785c61 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:38.577850 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-dbc5391c-a130-4883-98a1-1c141e785c61 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:38.711175 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-dbc5391c-a130-4883-98a1-1c141e785c61 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:38.719226 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-dbc5391c-a130-4883-98a1-1c141e785c61 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:38.720762 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-dbc5391c-a130-4883-98a1-1c141e785c61 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:38.721923 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-dbc5391c-a130-4883-98a1-1c141e785c61 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1733 microversion: 2.20 time: 0.156862 Jul 14 18:02:38.722478 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 481/1004] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:38 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:02:39.740680 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-6487f78d-0aba-4eae-8197-4e6559d63ed4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:39.741305 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-6487f78d-0aba-4eae-8197-4e6559d63ed4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:39.747777 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6487f78d-0aba-4eae-8197-4e6559d63ed4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:39.748256 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6487f78d-0aba-4eae-8197-4e6559d63ed4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:39.749026 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6487f78d-0aba-4eae-8197-4e6559d63ed4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:39.749464 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6487f78d-0aba-4eae-8197-4e6559d63ed4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:39.879631 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-6487f78d-0aba-4eae-8197-4e6559d63ed4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:39.887623 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-6487f78d-0aba-4eae-8197-4e6559d63ed4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:39.889196 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-6487f78d-0aba-4eae-8197-4e6559d63ed4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:39.890369 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-6487f78d-0aba-4eae-8197-4e6559d63ed4 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1733 microversion: 2.20 time: 0.154414 Jul 14 18:02:39.890941 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 524/1005] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:39 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:02:40.908682 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-a08881b7-c390-4781-981a-d7d220086493 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:40.909280 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-a08881b7-c390-4781-981a-d7d220086493 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:40.915958 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a08881b7-c390-4781-981a-d7d220086493 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:40.916403 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a08881b7-c390-4781-981a-d7d220086493 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:40.917180 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a08881b7-c390-4781-981a-d7d220086493 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:40.917628 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a08881b7-c390-4781-981a-d7d220086493 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:41.055338 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-a08881b7-c390-4781-981a-d7d220086493 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:41.063742 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-a08881b7-c390-4781-981a-d7d220086493 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:41.065293 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-a08881b7-c390-4781-981a-d7d220086493 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:41.066460 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-a08881b7-c390-4781-981a-d7d220086493 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1733 microversion: 2.20 time: 0.161736 Jul 14 18:02:41.067020 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 482/1006] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:40 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:02:42.086653 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-63ab4c42-dc61-4d76-81d4-02cfd13181c0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:42.087287 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-63ab4c42-dc61-4d76-81d4-02cfd13181c0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:42.094753 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-63ab4c42-dc61-4d76-81d4-02cfd13181c0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:42.095204 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-63ab4c42-dc61-4d76-81d4-02cfd13181c0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:42.096024 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-63ab4c42-dc61-4d76-81d4-02cfd13181c0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:42.096471 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-63ab4c42-dc61-4d76-81d4-02cfd13181c0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:42.233421 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-63ab4c42-dc61-4d76-81d4-02cfd13181c0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:42.241914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-63ab4c42-dc61-4d76-81d4-02cfd13181c0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:42.243424 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-63ab4c42-dc61-4d76-81d4-02cfd13181c0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:42.244637 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-63ab4c42-dc61-4d76-81d4-02cfd13181c0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1733 microversion: 2.20 time: 0.162983 Jul 14 18:02:42.245193 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 525/1007] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:42 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:02:43.262561 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-fa3abd01-5987-47cb-a9ef-54338fa14a9b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:43.263270 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-fa3abd01-5987-47cb-a9ef-54338fa14a9b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:43.269768 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fa3abd01-5987-47cb-a9ef-54338fa14a9b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:43.270216 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fa3abd01-5987-47cb-a9ef-54338fa14a9b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:43.271679 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fa3abd01-5987-47cb-a9ef-54338fa14a9b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:43.272151 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fa3abd01-5987-47cb-a9ef-54338fa14a9b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:43.400087 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-fa3abd01-5987-47cb-a9ef-54338fa14a9b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:43.408298 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-fa3abd01-5987-47cb-a9ef-54338fa14a9b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:43.409825 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-fa3abd01-5987-47cb-a9ef-54338fa14a9b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:43.411550 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-fa3abd01-5987-47cb-a9ef-54338fa14a9b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1733 microversion: 2.20 time: 0.152446 Jul 14 18:02:43.412151 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 483/1008] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:43 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:02:44.430412 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-508b2881-7bb6-4619-b5b2-254123ad6ccc tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:44.430948 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-508b2881-7bb6-4619-b5b2-254123ad6ccc tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:44.433304 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_api:SELECT=36 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:02:44.438779 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-508b2881-7bb6-4619-b5b2-254123ad6ccc tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:44.439212 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-508b2881-7bb6-4619-b5b2-254123ad6ccc tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:44.440033 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-508b2881-7bb6-4619-b5b2-254123ad6ccc tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:44.440477 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-508b2881-7bb6-4619-b5b2-254123ad6ccc tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:44.569420 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-508b2881-7bb6-4619-b5b2-254123ad6ccc tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:44.577429 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-508b2881-7bb6-4619-b5b2-254123ad6ccc tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:44.578923 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-508b2881-7bb6-4619-b5b2-254123ad6ccc tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:44.580130 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-508b2881-7bb6-4619-b5b2-254123ad6ccc tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1733 microversion: 2.20 time: 0.154356 Jul 14 18:02:44.580688 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 526/1009] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:44 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:02:45.597205 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-bb2995b3-9e8c-4973-846d-7e4783def304 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:45.597816 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-bb2995b3-9e8c-4973-846d-7e4783def304 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:45.600151 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_api:SELECT=36 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:02:45.605666 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-bb2995b3-9e8c-4973-846d-7e4783def304 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:45.606120 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-bb2995b3-9e8c-4973-846d-7e4783def304 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:45.606883 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-bb2995b3-9e8c-4973-846d-7e4783def304 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:45.607324 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-bb2995b3-9e8c-4973-846d-7e4783def304 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:45.736182 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-bb2995b3-9e8c-4973-846d-7e4783def304 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:45.744869 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-bb2995b3-9e8c-4973-846d-7e4783def304 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:45.746384 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-bb2995b3-9e8c-4973-846d-7e4783def304 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:45.747538 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-bb2995b3-9e8c-4973-846d-7e4783def304 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1733 microversion: 2.20 time: 0.154271 Jul 14 18:02:45.748128 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 484/1010] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:45 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:02:46.253948 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-f098a62c-7873-41a0-8ac4-fd5dd5a8c08d tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f81555e6-93ce-4d27-bd36-2ca1877b9cfc", "device": "/dev/sdb"}} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:02:46.255570 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-f098a62c-7873-41a0-8ac4-fd5dd5a8c08d tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: fc746cb3-bf0e-4f30-b58a-da488ca22206] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:46.262313 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f098a62c-7873-41a0-8ac4-fd5dd5a8c08d tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:46.262764 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f098a62c-7873-41a0-8ac4-fd5dd5a8c08d tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:46.263541 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f098a62c-7873-41a0-8ac4-fd5dd5a8c08d tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:46.264006 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f098a62c-7873-41a0-8ac4-fd5dd5a8c08d tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:46.569574 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-f098a62c-7873-41a0-8ac4-fd5dd5a8c08d tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "POST /compute/v2.1/servers/fc746cb3-bf0e-4f30-b58a-da488ca22206/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319331 Jul 14 18:02:46.570218 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 527/1011] 10.222.0.64 () {60 vars in 1322 bytes} [Thu Jul 14 18:02:46 2022] POST /compute/v2.1/servers/fc746cb3-bf0e-4f30-b58a-da488ca22206/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:02:46.766125 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-70612438-59b2-4fcc-ab1e-c5a672ef85bf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:46.766738 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-70612438-59b2-4fcc-ab1e-c5a672ef85bf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:46.774071 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-70612438-59b2-4fcc-ab1e-c5a672ef85bf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:46.774580 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-70612438-59b2-4fcc-ab1e-c5a672ef85bf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:46.775360 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-70612438-59b2-4fcc-ab1e-c5a672ef85bf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:46.775802 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-70612438-59b2-4fcc-ab1e-c5a672ef85bf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:46.909765 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-70612438-59b2-4fcc-ab1e-c5a672ef85bf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:46.918104 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-70612438-59b2-4fcc-ab1e-c5a672ef85bf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:46.919629 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-70612438-59b2-4fcc-ab1e-c5a672ef85bf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:46.920824 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-70612438-59b2-4fcc-ab1e-c5a672ef85bf tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1733 microversion: 2.20 time: 0.158621 Jul 14 18:02:46.921385 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 485/1012] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:46 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:02:47.940458 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-3b095720-572b-48a3-b84a-d0169de67481 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:47.941069 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-3b095720-572b-48a3-b84a-d0169de67481 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:47.947316 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3b095720-572b-48a3-b84a-d0169de67481 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:47.947764 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3b095720-572b-48a3-b84a-d0169de67481 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:47.948547 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3b095720-572b-48a3-b84a-d0169de67481 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:47.949008 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3b095720-572b-48a3-b84a-d0169de67481 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:48.080276 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-3b095720-572b-48a3-b84a-d0169de67481 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:48.088785 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-3b095720-572b-48a3-b84a-d0169de67481 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:48.090281 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-3b095720-572b-48a3-b84a-d0169de67481 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:48.091430 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-3b095720-572b-48a3-b84a-d0169de67481 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1733 microversion: 2.20 time: 0.155934 Jul 14 18:02:48.092008 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 528/1013] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:47 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:02:49.108523 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-1a2ad142-dccb-4b0a-9445-5566fb1a6999 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:49.109131 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-1a2ad142-dccb-4b0a-9445-5566fb1a6999 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:49.116211 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1a2ad142-dccb-4b0a-9445-5566fb1a6999 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:49.116673 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1a2ad142-dccb-4b0a-9445-5566fb1a6999 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:49.117454 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1a2ad142-dccb-4b0a-9445-5566fb1a6999 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:49.117894 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1a2ad142-dccb-4b0a-9445-5566fb1a6999 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:49.246364 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-1a2ad142-dccb-4b0a-9445-5566fb1a6999 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:49.254719 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-1a2ad142-dccb-4b0a-9445-5566fb1a6999 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:49.256274 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-1a2ad142-dccb-4b0a-9445-5566fb1a6999 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:49.257446 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-1a2ad142-dccb-4b0a-9445-5566fb1a6999 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1733 microversion: 2.20 time: 0.152828 Jul 14 18:02:49.258011 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 486/1014] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:49 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:02:50.276394 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-5740ae1c-2651-48f8-8cfd-d931abd98d51 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:50.277001 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-5740ae1c-2651-48f8-8cfd-d931abd98d51 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:50.283538 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5740ae1c-2651-48f8-8cfd-d931abd98d51 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:50.284020 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5740ae1c-2651-48f8-8cfd-d931abd98d51 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:50.284787 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5740ae1c-2651-48f8-8cfd-d931abd98d51 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:50.285800 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5740ae1c-2651-48f8-8cfd-d931abd98d51 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:50.415634 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-5740ae1c-2651-48f8-8cfd-d931abd98d51 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:50.423808 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-5740ae1c-2651-48f8-8cfd-d931abd98d51 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:50.425342 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-5740ae1c-2651-48f8-8cfd-d931abd98d51 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:50.426580 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-5740ae1c-2651-48f8-8cfd-d931abd98d51 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1733 microversion: 2.20 time: 0.154123 Jul 14 18:02:50.427144 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 529/1015] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:50 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 18:02:50.732745 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-ee563ab8-86c4-49e9-a94c-917f48549bef req-bfe9ab58-c25f-4310-8417-6a3f3b5456b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "509b127f-76cb-4358-84a9-457d4e0397ec", "name": "network-vif-plugged", "status": "completed", "tag": "ab754da5-453e-411a-a26f-b36d77ef6e13"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:02:50.742372 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-ee563ab8-86c4-49e9-a94c-917f48549bef req-bfe9ab58-c25f-4310-8417-6a3f3b5456b3 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:50.742808 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-ee563ab8-86c4-49e9-a94c-917f48549bef req-bfe9ab58-c25f-4310-8417-6a3f3b5456b3 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:50.754059 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-ee563ab8-86c4-49e9-a94c-917f48549bef req-bfe9ab58-c25f-4310-8417-6a3f3b5456b3 service nova] Creating event network-vif-plugged:ab754da5-453e-411a-a26f-b36d77ef6e13 for instance 509b127f-76cb-4358-84a9-457d4e0397ec on hv-cinder-84989 Jul 14 18:02:50.759137 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-ee563ab8-86c4-49e9-a94c-917f48549bef req-bfe9ab58-c25f-4310-8417-6a3f3b5456b3 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030078 Jul 14 18:02:50.759735 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 487/1016] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:02:51.445278 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-6830f9d8-0cae-4d5f-9792-f6f782fbeb6a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:51.445933 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-6830f9d8-0cae-4d5f-9792-f6f782fbeb6a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:51.452581 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6830f9d8-0cae-4d5f-9792-f6f782fbeb6a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:51.453034 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6830f9d8-0cae-4d5f-9792-f6f782fbeb6a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:51.453810 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6830f9d8-0cae-4d5f-9792-f6f782fbeb6a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:51.454253 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6830f9d8-0cae-4d5f-9792-f6f782fbeb6a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:51.585171 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-6830f9d8-0cae-4d5f-9792-f6f782fbeb6a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:51.593395 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-6830f9d8-0cae-4d5f-9792-f6f782fbeb6a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:51.595018 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-6830f9d8-0cae-4d5f-9792-f6f782fbeb6a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:51.596275 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-6830f9d8-0cae-4d5f-9792-f6f782fbeb6a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1733 microversion: 2.20 time: 0.155352 Jul 14 18:02:51.596966 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 530/1017] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:51 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:02:52.615597 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-744ecb34-73e9-4d83-ac51-0a9b8011382f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:52.616332 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-744ecb34-73e9-4d83-ac51-0a9b8011382f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:52.622681 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-744ecb34-73e9-4d83-ac51-0a9b8011382f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:52.623164 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-744ecb34-73e9-4d83-ac51-0a9b8011382f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:52.623960 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-744ecb34-73e9-4d83-ac51-0a9b8011382f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:52.624411 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-744ecb34-73e9-4d83-ac51-0a9b8011382f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:52.753638 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-744ecb34-73e9-4d83-ac51-0a9b8011382f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:52.761816 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-744ecb34-73e9-4d83-ac51-0a9b8011382f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:52.763358 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-744ecb34-73e9-4d83-ac51-0a9b8011382f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:52.764537 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-744ecb34-73e9-4d83-ac51-0a9b8011382f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1733 microversion: 2.20 time: 0.153712 Jul 14 18:02:52.765102 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 488/1018] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:52 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:02:53.782741 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-583320b4-66e4-44c3-8619-5e838c0fc48d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:53.783287 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-583320b4-66e4-44c3-8619-5e838c0fc48d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:53.790358 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-583320b4-66e4-44c3-8619-5e838c0fc48d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:53.790809 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-583320b4-66e4-44c3-8619-5e838c0fc48d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:53.791671 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-583320b4-66e4-44c3-8619-5e838c0fc48d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:53.792210 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-583320b4-66e4-44c3-8619-5e838c0fc48d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:53.923848 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-583320b4-66e4-44c3-8619-5e838c0fc48d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:53.932524 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-583320b4-66e4-44c3-8619-5e838c0fc48d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:53.934023 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-583320b4-66e4-44c3-8619-5e838c0fc48d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:53.935219 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-583320b4-66e4-44c3-8619-5e838c0fc48d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1733 microversion: 2.20 time: 0.156549 Jul 14 18:02:53.935781 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 531/1019] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:53 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:02:54.952219 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-d5a50e4a-f607-46f6-a9de-dbd798ad701b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:02:54.952841 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-d5a50e4a-f607-46f6-a9de-dbd798ad701b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:02:54.959269 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d5a50e4a-f607-46f6-a9de-dbd798ad701b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:54.959723 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d5a50e4a-f607-46f6-a9de-dbd798ad701b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:54.960535 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d5a50e4a-f607-46f6-a9de-dbd798ad701b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:02:54.960974 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d5a50e4a-f607-46f6-a9de-dbd798ad701b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:02:55.090020 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-d5a50e4a-f607-46f6-a9de-dbd798ad701b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:55.100463 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-d5a50e4a-f607-46f6-a9de-dbd798ad701b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:55.101985 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-d5a50e4a-f607-46f6-a9de-dbd798ad701b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:02:55.103624 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-d5a50e4a-f607-46f6-a9de-dbd798ad701b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1720 microversion: 2.20 time: 0.155354 Jul 14 18:02:55.104415 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 489/1020] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:02:54 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:03:02.245839 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-e550b6e2-ce8f-49e8-aa9f-59001d9c8395 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:02.246340 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-e550b6e2-ce8f-49e8-aa9f-59001d9c8395 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: c25aaf9b-059d-4605-8607-8810702e9ee7] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:02.252424 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e550b6e2-ce8f-49e8-aa9f-59001d9c8395 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:02.252875 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e550b6e2-ce8f-49e8-aa9f-59001d9c8395 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:02.253667 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e550b6e2-ce8f-49e8-aa9f-59001d9c8395 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:02.254099 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e550b6e2-ce8f-49e8-aa9f-59001d9c8395 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:02.257747 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:03:02.278232 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-e550b6e2-ce8f-49e8-aa9f-59001d9c8395 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7/ips" status: 200 len: 145 microversion: 2.1 time: 0.168573 Jul 14 18:03:02.278875 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 532/1021] 10.222.0.64 () {58 vars in 1247 bytes} [Thu Jul 14 18:03:02 2022] GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7/ips => generated 145 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:03:07.795225 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-cb796b21-9459-44ab-b5a3-98c66f591b03 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb1caddf-b31d-4e24-a309-0d734c8c87af"}} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:03:07.796358 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-cb796b21-9459-44ab-b5a3-98c66f591b03 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: c25aaf9b-059d-4605-8607-8810702e9ee7] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:07.800239 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_api:SELECT=11 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:03:07.800953 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=80 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:03:07.804938 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-cb796b21-9459-44ab-b5a3-98c66f591b03 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:07.805386 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-cb796b21-9459-44ab-b5a3-98c66f591b03 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:07.806160 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-cb796b21-9459-44ab-b5a3-98c66f591b03 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:07.806598 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-cb796b21-9459-44ab-b5a3-98c66f591b03 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:11.160837 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-cb796b21-9459-44ab-b5a3-98c66f591b03 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "POST /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.369555 Jul 14 18:03:11.161539 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 490/1022] 10.222.0.64 () {60 vars in 1322 bytes} [Thu Jul 14 18:03:07 2022] POST /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7/os-volume_attachments => generated 194 bytes in 3371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:03:16.420714 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-d03df070-55b7-4972-b284-d6ac3f941ce8 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:16.421253 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-d03df070-55b7-4972-b284-d6ac3f941ce8 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: fc746cb3-bf0e-4f30-b58a-da488ca22206] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:16.423959 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_api:SELECT=13 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:03:16.434049 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d03df070-55b7-4972-b284-d6ac3f941ce8 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:16.436745 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d03df070-55b7-4972-b284-d6ac3f941ce8 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:16.437533 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d03df070-55b7-4972-b284-d6ac3f941ce8 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:16.437975 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d03df070-55b7-4972-b284-d6ac3f941ce8 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:16.519613 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.objects.instance [None req-d03df070-55b7-4972-b284-d6ac3f941ce8 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lazy-loading 'services' on Instance uuid fc746cb3-bf0e-4f30-b58a-da488ca22206 {{(pid=129471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 18:03:16.592608 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-d03df070-55b7-4972-b284-d6ac3f941ce8 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "DELETE /compute/v2.1/servers/fc746cb3-bf0e-4f30-b58a-da488ca22206/os-volume_attachments/f81555e6-93ce-4d27-bd36-2ca1877b9cfc" status: 202 len: 0 microversion: 2.1 time: 0.175791 Jul 14 18:03:16.593345 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 533/1023] 10.222.0.64 () {58 vars in 1415 bytes} [Thu Jul 14 18:03:16 2022] DELETE /compute/v2.1/servers/fc746cb3-bf0e-4f30-b58a-da488ca22206/os-volume_attachments/f81555e6-93ce-4d27-bd36-2ca1877b9cfc => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 18:03:19.708447 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_api:SELECT=2 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:03:19.712946 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-a79fc37a-bba4-4083-aa6b-9fb96037cf79 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:19.713990 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-a79fc37a-bba4-4083-aa6b-9fb96037cf79 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: c25aaf9b-059d-4605-8607-8810702e9ee7] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:19.725748 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a79fc37a-bba4-4083-aa6b-9fb96037cf79 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:19.726207 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a79fc37a-bba4-4083-aa6b-9fb96037cf79 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:19.726970 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a79fc37a-bba4-4083-aa6b-9fb96037cf79 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:19.727406 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a79fc37a-bba4-4083-aa6b-9fb96037cf79 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:19.759940 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-a79fc37a-bba4-4083-aa6b-9fb96037cf79 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052880 Jul 14 18:03:19.760525 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 491/1024] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Jul 14 18:03:19 2022] GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:03:19.771043 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-de3b667f-ebd6-4b21-834b-4ac3a8fb8fbe tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:19.771634 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-de3b667f-ebd6-4b21-834b-4ac3a8fb8fbe tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: c25aaf9b-059d-4605-8607-8810702e9ee7] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:19.779276 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-de3b667f-ebd6-4b21-834b-4ac3a8fb8fbe tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:19.779734 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-de3b667f-ebd6-4b21-834b-4ac3a8fb8fbe tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:19.780554 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-de3b667f-ebd6-4b21-834b-4ac3a8fb8fbe tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:19.780996 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-de3b667f-ebd6-4b21-834b-4ac3a8fb8fbe tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:19.810241 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-de3b667f-ebd6-4b21-834b-4ac3a8fb8fbe tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7/os-volume_attachments/cb1caddf-b31d-4e24-a309-0d734c8c87af" status: 200 len: 194 microversion: 2.1 time: 0.043519 Jul 14 18:03:19.810833 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 534/1025] 10.222.0.64 () {58 vars in 1412 bytes} [Thu Jul 14 18:03:19 2022] GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7/os-volume_attachments/cb1caddf-b31d-4e24-a309-0d734c8c87af => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:03:19.848966 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-d40bbcbf-11c0-4176-8dcd-5e307d03b3ba tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:19.849728 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-d40bbcbf-11c0-4176-8dcd-5e307d03b3ba tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: fc746cb3-bf0e-4f30-b58a-da488ca22206] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:19.856892 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d40bbcbf-11c0-4176-8dcd-5e307d03b3ba tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:19.857348 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d40bbcbf-11c0-4176-8dcd-5e307d03b3ba tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:19.858125 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d40bbcbf-11c0-4176-8dcd-5e307d03b3ba tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:19.858570 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d40bbcbf-11c0-4176-8dcd-5e307d03b3ba tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:19.883759 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-d40bbcbf-11c0-4176-8dcd-5e307d03b3ba tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: fc746cb3-bf0e-4f30-b58a-da488ca22206] Going to try to terminate instance {{(pid=129470) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 18:03:19.966268 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-d40bbcbf-11c0-4176-8dcd-5e307d03b3ba tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "DELETE /compute/v2.1/servers/fc746cb3-bf0e-4f30-b58a-da488ca22206" status: 204 len: 0 microversion: 2.1 time: 0.120059 Jul 14 18:03:19.966963 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 492/1026] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Jul 14 18:03:19 2022] DELETE /compute/v2.1/servers/fc746cb3-bf0e-4f30-b58a-da488ca22206 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 18:03:19.975347 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-5cb66132-a806-416a-9202-c84e00fac741 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:19.976060 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-5cb66132-a806-416a-9202-c84e00fac741 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: fc746cb3-bf0e-4f30-b58a-da488ca22206] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:19.983061 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5cb66132-a806-416a-9202-c84e00fac741 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:19.983602 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5cb66132-a806-416a-9202-c84e00fac741 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:19.984610 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5cb66132-a806-416a-9202-c84e00fac741 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:19.985049 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5cb66132-a806-416a-9202-c84e00fac741 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:20.133664 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-5cb66132-a806-416a-9202-c84e00fac741 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dd1356e5bc4d35aca1bf1edf6f2140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ce085523d84754b8d107b5c0936491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:03:20.143427 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-5cb66132-a806-416a-9202-c84e00fac741 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "GET /compute/v2.1/servers/fc746cb3-bf0e-4f30-b58a-da488ca22206" status: 200 len: 1513 microversion: 2.1 time: 0.170460 Jul 14 18:03:20.143427 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 535/1027] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:03:19 2022] GET /compute/v2.1/servers/fc746cb3-bf0e-4f30-b58a-da488ca22206 => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 18:03:21.159696 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-f2cca4de-ff52-40c7-84f2-5f781865f542 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:21.160435 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-f2cca4de-ff52-40c7-84f2-5f781865f542 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: fc746cb3-bf0e-4f30-b58a-da488ca22206] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:21.166921 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f2cca4de-ff52-40c7-84f2-5f781865f542 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:21.167436 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f2cca4de-ff52-40c7-84f2-5f781865f542 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:21.168337 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f2cca4de-ff52-40c7-84f2-5f781865f542 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:21.168581 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f2cca4de-ff52-40c7-84f2-5f781865f542 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:21.183788 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-f1f937ac-3fab-4589-927a-0e3c39dc7109 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99404906-ad4c-45bb-974d-652d2d4880e6"}} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:03:21.184946 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-f1f937ac-3fab-4589-927a-0e3c39dc7109 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: c25aaf9b-059d-4605-8607-8810702e9ee7] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:21.191493 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f1f937ac-3fab-4589-927a-0e3c39dc7109 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:21.192093 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f1f937ac-3fab-4589-927a-0e3c39dc7109 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:21.192762 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f1f937ac-3fab-4589-927a-0e3c39dc7109 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:21.193240 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f1f937ac-3fab-4589-927a-0e3c39dc7109 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:21.301582 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-f2cca4de-ff52-40c7-84f2-5f781865f542 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dd1356e5bc4d35aca1bf1edf6f2140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ce085523d84754b8d107b5c0936491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:03:21.309816 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-f2cca4de-ff52-40c7-84f2-5f781865f542 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "GET /compute/v2.1/servers/fc746cb3-bf0e-4f30-b58a-da488ca22206" status: 200 len: 1513 microversion: 2.1 time: 0.154319 Jul 14 18:03:21.310401 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 493/1028] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:03:21 2022] GET /compute/v2.1/servers/fc746cb3-bf0e-4f30-b58a-da488ca22206 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:03:21.619445 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-f1f937ac-3fab-4589-927a-0e3c39dc7109 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "POST /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.439663 Jul 14 18:03:21.620177 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 536/1029] 10.222.0.64 () {60 vars in 1322 bytes} [Thu Jul 14 18:03:21 2022] POST /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7/os-volume_attachments => generated 194 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 18:03:22.326697 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-6c6a175c-517c-42bc-b6dc-cc151a6b51d3 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:22.327329 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-6c6a175c-517c-42bc-b6dc-cc151a6b51d3 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: fc746cb3-bf0e-4f30-b58a-da488ca22206] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:22.333962 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6c6a175c-517c-42bc-b6dc-cc151a6b51d3 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:22.334419 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6c6a175c-517c-42bc-b6dc-cc151a6b51d3 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:22.335336 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6c6a175c-517c-42bc-b6dc-cc151a6b51d3 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:22.335646 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6c6a175c-517c-42bc-b6dc-cc151a6b51d3 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:22.475389 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-6c6a175c-517c-42bc-b6dc-cc151a6b51d3 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dd1356e5bc4d35aca1bf1edf6f2140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ce085523d84754b8d107b5c0936491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:03:22.483460 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-6c6a175c-517c-42bc-b6dc-cc151a6b51d3 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "GET /compute/v2.1/servers/fc746cb3-bf0e-4f30-b58a-da488ca22206" status: 200 len: 1513 microversion: 2.1 time: 0.160659 Jul 14 18:03:22.484058 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 494/1030] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:03:22 2022] GET /compute/v2.1/servers/fc746cb3-bf0e-4f30-b58a-da488ca22206 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:03:22.661730 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [req-84145b11-18b1-4137-97ee-d660b61a029d req-ca3eb7ab-d12d-4350-b654-b4dfa48678c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc746cb3-bf0e-4f30-b58a-da488ca22206", "name": "network-vif-deleted", "tag": "9b464089-2e21-4cde-a5ab-eae09e6e9d09"}]} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:03:22.672776 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-84145b11-18b1-4137-97ee-d660b61a029d req-ca3eb7ab-d12d-4350-b654-b4dfa48678c4 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:22.673224 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-84145b11-18b1-4137-97ee-d660b61a029d req-ca3eb7ab-d12d-4350-b654-b4dfa48678c4 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:22.695385 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.compute.server_external_events [req-84145b11-18b1-4137-97ee-d660b61a029d req-ca3eb7ab-d12d-4350-b654-b4dfa48678c4 service nova] Creating event network-vif-deleted:9b464089-2e21-4cde-a5ab-eae09e6e9d09 for instance fc746cb3-bf0e-4f30-b58a-da488ca22206 on hv-cinder-84989 Jul 14 18:03:22.700529 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [req-84145b11-18b1-4137-97ee-d660b61a029d req-ca3eb7ab-d12d-4350-b654-b4dfa48678c4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048118 Jul 14 18:03:22.701351 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 537/1031] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:03:23.501160 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-5b1d1d72-99d6-421b-8871-5b09731ce4ba tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:23.501766 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-5b1d1d72-99d6-421b-8871-5b09731ce4ba tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: fc746cb3-bf0e-4f30-b58a-da488ca22206] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:23.508366 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5b1d1d72-99d6-421b-8871-5b09731ce4ba tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:23.508820 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5b1d1d72-99d6-421b-8871-5b09731ce4ba tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:23.509585 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5b1d1d72-99d6-421b-8871-5b09731ce4ba tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:23.510031 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5b1d1d72-99d6-421b-8871-5b09731ce4ba tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:23.523614 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.wsgi [None req-5b1d1d72-99d6-421b-8871-5b09731ce4ba tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] HTTP exception thrown: Instance fc746cb3-bf0e-4f30-b58a-da488ca22206 could not be found. Jul 14 18:03:23.525285 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-5b1d1d72-99d6-421b-8871-5b09731ce4ba tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Request method failure captured: Jul 14 18:03:23.525285 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: request: GET /compute/v2.1/servers/fc746cb3-bf0e-4f30-b58a-da488ca22206 HTTP/1.1 Jul 14 18:03:23.525285 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept: application/json Jul 14 18:03:23.525285 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept-Encoding: identity Jul 14 18:03:23.525285 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Connection: close Jul 14 18:03:23.525285 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Length: 0 Jul 14 18:03:23.525285 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Type: application/json Jul 14 18:03:23.525285 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Host: 10.222.0.64 Jul 14 18:03:23.525285 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Openstack-System-Scope: None Jul 14 18:03:23.525285 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: User-Agent: python-urllib3/1.26.9 Jul 14 18:03:23.525285 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Auth-Token: gAAAAABi0FoatFPS1l048NvrH728aj6tL2yzEX1Yy8KG7WwqWCTnRLgG6dYORmdiSrx-auSbfYtpTo6iptXDZr6XpeS1saowOiCwrmiQ0V7A0CGBsuniEwq0e6cCDlgwZEdBJ5i0fNBvRmcJUfCrs4FUV7L9J7xtvRJe34h568oViCbqIfKb9X8 Jul 14 18:03:23.525285 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Id: None Jul 14 18:03:23.525285 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Name: None Jul 14 18:03:23.525285 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Identity-Status: Confirmed Jul 14 18:03:23.525285 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Is-Admin-Project: True Jul 14 18:03:23.525285 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Id: default Jul 14 18:03:23.525285 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Name: Default Jul 14 18:03:23.525285 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Id: 73ce085523d84754b8d107b5c0936491 Jul 14 18:03:23.525285 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2108847370 Jul 14 18:03:23.525285 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Role: reader,member Jul 14 18:03:23.525285 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Roles: reader,member Jul 14 18:03:23.526984 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/73ce085523d84754b8d107b5c0936491"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/73ce085523d84754b8d107b5c0936491"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/73ce085523d84754b8d107b5c0936491"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_73ce085523d84754b8d107b5c0936491", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:03:23.526984 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant: tempest-VolumesSnapshotTestJSON-2108847370 Jul 14 18:03:23.526984 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Id: 73ce085523d84754b8d107b5c0936491 Jul 14 18:03:23.526984 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2108847370 Jul 14 18:03:23.526984 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User: tempest-VolumesSnapshotTestJSON-2108847370-project Jul 14 18:03:23.526984 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Id: default Jul 14 18:03:23.526984 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Name: Default Jul 14 18:03:23.526984 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Id: d8dd1356e5bc4d35aca1bf1edf6f2140 Jul 14 18:03:23.526984 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Name: tempest-VolumesSnapshotTestJSON-2108847370-project Jul 14 18:03:23.526984 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: method: > Jul 14 18:03:23.526984 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: exception: Instance fc746cb3-bf0e-4f30-b58a-da488ca22206 could not be found. Jul 14 18:03:23.526984 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: action_args: {'id': 'fc746cb3-bf0e-4f30-b58a-da488ca22206'} Jul 14 18:03:23.528591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:03:23.528591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:03:23.528591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 18:03:23.528591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 18:03:23.528591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 18:03:23.528591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 18:03:23.528591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 18:03:23.528591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 18:03:23.528591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 18:03:23.528591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 18:03:23.528591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc746cb3-bf0e-4f30-b58a-da488ca22206 could not be found. Jul 14 18:03:23.528591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:03:23.528591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:03:23.528591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:03:23.528591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:03:23.528591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:03:23.528591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:03:23.528591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:03:23.528591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:03:23.528591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:03:23.530283 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:03:23.530283 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 18:03:23.530283 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 18:03:23.530283 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 18:03:23.530283 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 18:03:23.530283 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 18:03:23.530283 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 18:03:23.530283 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc746cb3-bf0e-4f30-b58a-da488ca22206 could not be found. Jul 14 18:03:23.530283 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:03:23.530283 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:03:23.530283 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:03:23.530283 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:03:23.530283 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:03:23.530283 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:03:23.530283 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 18:03:23.530283 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 18:03:23.530283 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc746cb3-bf0e-4f30-b58a-da488ca22206 could not be found. Jul 14 18:03:23.530283 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:03:23.531720 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-5b1d1d72-99d6-421b-8871-5b09731ce4ba tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Returning 404 to user: Instance fc746cb3-bf0e-4f30-b58a-da488ca22206 could not be found. {{(pid=129470) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:03:23.531720 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-5b1d1d72-99d6-421b-8871-5b09731ce4ba tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "GET /compute/v2.1/servers/fc746cb3-bf0e-4f30-b58a-da488ca22206" status: 404 len: 111 microversion: 2.1 time: 0.029485 Jul 14 18:03:23.531720 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 495/1032] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:03:23 2022] GET /compute/v2.1/servers/fc746cb3-bf0e-4f30-b58a-da488ca22206 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 18:03:30.178330 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-c584a2a9-6a23-421b-a785-88c83708dde6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:30.179341 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-c584a2a9-6a23-421b-a785-88c83708dde6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: c25aaf9b-059d-4605-8607-8810702e9ee7] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:30.186481 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c584a2a9-6a23-421b-a785-88c83708dde6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:30.186940 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c584a2a9-6a23-421b-a785-88c83708dde6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:30.187722 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c584a2a9-6a23-421b-a785-88c83708dde6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:30.188211 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c584a2a9-6a23-421b-a785-88c83708dde6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:30.222922 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-c584a2a9-6a23-421b-a785-88c83708dde6 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049530 Jul 14 18:03:30.223417 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 538/1033] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Jul 14 18:03:30 2022] GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:03:30.377142 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-9642edfe-4c00-4542-9295-bfc71e12a491 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:30.377682 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-9642edfe-4c00-4542-9295-bfc71e12a491 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: c25aaf9b-059d-4605-8607-8810702e9ee7] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:30.384308 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9642edfe-4c00-4542-9295-bfc71e12a491 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:30.384770 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9642edfe-4c00-4542-9295-bfc71e12a491 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:30.385545 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9642edfe-4c00-4542-9295-bfc71e12a491 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:30.386019 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9642edfe-4c00-4542-9295-bfc71e12a491 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:30.414848 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-9642edfe-4c00-4542-9295-bfc71e12a491 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7/os-volume_attachments/cb1caddf-b31d-4e24-a309-0d734c8c87af" status: 200 len: 194 microversion: 2.1 time: 0.041872 Jul 14 18:03:30.416136 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 496/1034] 10.222.0.64 () {58 vars in 1412 bytes} [Thu Jul 14 18:03:30 2022] GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7/os-volume_attachments/cb1caddf-b31d-4e24-a309-0d734c8c87af => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:03:30.425699 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-aeec0198-c37c-46df-b8cf-53a4dac8e2fa tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:30.426181 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-aeec0198-c37c-46df-b8cf-53a4dac8e2fa tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: c25aaf9b-059d-4605-8607-8810702e9ee7] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:30.432612 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-aeec0198-c37c-46df-b8cf-53a4dac8e2fa tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:30.433064 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-aeec0198-c37c-46df-b8cf-53a4dac8e2fa tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:30.433858 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-aeec0198-c37c-46df-b8cf-53a4dac8e2fa tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:30.434299 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-aeec0198-c37c-46df-b8cf-53a4dac8e2fa tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:30.513643 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.objects.instance [None req-aeec0198-c37c-46df-b8cf-53a4dac8e2fa tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lazy-loading 'services' on Instance uuid c25aaf9b-059d-4605-8607-8810702e9ee7 {{(pid=129471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 18:03:30.583300 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-aeec0198-c37c-46df-b8cf-53a4dac8e2fa tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "DELETE /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7/os-volume_attachments/cb1caddf-b31d-4e24-a309-0d734c8c87af" status: 202 len: 0 microversion: 2.1 time: 0.161417 Jul 14 18:03:30.583884 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 539/1035] 10.222.0.64 () {58 vars in 1415 bytes} [Thu Jul 14 18:03:30 2022] DELETE /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7/os-volume_attachments/cb1caddf-b31d-4e24-a309-0d734c8c87af => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 18:03:35.462139 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-34e971b5-07c8-43d5-9c3d-281d2cffac6c tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-344028879", "imageRef": "cf1f5d8c-9e49-4272-8e19-8e3c587056e1", "flavorRef": "452", "networks": [{"uuid": "bc78a282-f93c-447e-aeef-e773d7815fbd"}]}} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:03:35.515933 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.network.neutron [None req-34e971b5-07c8-43d5-9c3d-281d2cffac6c tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] validate_networks() for [('bc78a282-f93c-447e-aeef-e773d7815fbd', None, None, None, None, None)] {{(pid=129470) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 18:03:35.906689 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-855413e6-63b2-4216-8e92-8c8594bd3e75 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:35.907286 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-855413e6-63b2-4216-8e92-8c8594bd3e75 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: c25aaf9b-059d-4605-8607-8810702e9ee7] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:35.911777 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-34e971b5-07c8-43d5-9c3d-281d2cffac6c tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Flavor limits 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 18:03:35.912282 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-34e971b5-07c8-43d5-9c3d-281d2cffac6c tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Image limits 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 18:03:35.912766 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-34e971b5-07c8-43d5-9c3d-281d2cffac6c tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Flavor pref 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 18:03:35.913183 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-34e971b5-07c8-43d5-9c3d-281d2cffac6c tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Image pref 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 18:03:35.914122 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-34e971b5-07c8-43d5-9c3d-281d2cffac6c tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 18:03:35.914247 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-855413e6-63b2-4216-8e92-8c8594bd3e75 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:35.914621 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-855413e6-63b2-4216-8e92-8c8594bd3e75 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:35.915397 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-855413e6-63b2-4216-8e92-8c8594bd3e75 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:35.915836 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-855413e6-63b2-4216-8e92-8c8594bd3e75 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:35.923953 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-34e971b5-07c8-43d5-9c3d-281d2cffac6c tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:35.924418 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-34e971b5-07c8-43d5-9c3d-281d2cffac6c tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:35.925229 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-34e971b5-07c8-43d5-9c3d-281d2cffac6c tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:35.925669 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-34e971b5-07c8-43d5-9c3d-281d2cffac6c tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:35.944079 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.quota [None req-34e971b5-07c8-43d5-9c3d-281d2cffac6c tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Getting quotas for project 73ce085523d84754b8d107b5c0936491. Resources: {'ram', 'cores', 'instances'} {{(pid=129470) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 18:03:35.945201 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-855413e6-63b2-4216-8e92-8c8594bd3e75 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7/os-volume_attachments/99404906-ad4c-45bb-974d-652d2d4880e6" status: 200 len: 194 microversion: 2.1 time: 0.043331 Jul 14 18:03:35.945853 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 540/1036] 10.222.0.64 () {58 vars in 1412 bytes} [Thu Jul 14 18:03:35 2022] GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7/os-volume_attachments/99404906-ad4c-45bb-974d-652d2d4880e6 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 18:03:35.950281 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.quota [None req-34e971b5-07c8-43d5-9c3d-281d2cffac6c tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Getting quotas for user d8dd1356e5bc4d35aca1bf1edf6f2140 and project 73ce085523d84754b8d107b5c0936491. Resources: {'ram', 'cores', 'instances'} {{(pid=129470) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 18:03:35.955417 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-79fe381f-fcd0-44a1-8383-b57690633d6e tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:35.955913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-79fe381f-fcd0-44a1-8383-b57690633d6e tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: c25aaf9b-059d-4605-8607-8810702e9ee7] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:35.961861 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-34e971b5-07c8-43d5-9c3d-281d2cffac6c tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Going to run 1 instances... {{(pid=129470) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 18:03:35.962029 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-79fe381f-fcd0-44a1-8383-b57690633d6e tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:35.962309 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-79fe381f-fcd0-44a1-8383-b57690633d6e tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:35.963077 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-79fe381f-fcd0-44a1-8383-b57690633d6e tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:35.963513 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-79fe381f-fcd0-44a1-8383-b57690633d6e tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:35.964183 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-34e971b5-07c8-43d5-9c3d-281d2cffac6c tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: b365d72e-49c5-4ad5-a92a-0e2de1580bbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf1f5d8c-9e49-4272-8e19-8e3c587056e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129470) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 18:03:36.010911 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-34e971b5-07c8-43d5-9c3d-281d2cffac6c tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.553234 Jul 14 18:03:36.011813 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 497/1037] 10.222.0.64 () {60 vars in 1146 bytes} [Thu Jul 14 18:03:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 18:03:36.021756 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-480a3a2d-41cc-4f60-9da5-5da7ad511399 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:36.022366 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-480a3a2d-41cc-4f60-9da5-5da7ad511399 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: b365d72e-49c5-4ad5-a92a-0e2de1580bbf] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:36.051736 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.objects.instance [None req-79fe381f-fcd0-44a1-8383-b57690633d6e tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lazy-loading 'services' on Instance uuid c25aaf9b-059d-4605-8607-8810702e9ee7 {{(pid=129471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 18:03:36.084637 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-480a3a2d-41cc-4f60-9da5-5da7ad511399 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dd1356e5bc4d35aca1bf1edf6f2140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ce085523d84754b8d107b5c0936491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:03:36.091972 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-480a3a2d-41cc-4f60-9da5-5da7ad511399 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "GET /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf" status: 200 len: 1218 microversion: 2.1 time: 0.073534 Jul 14 18:03:36.092161 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 498/1038] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:03:36 2022] GET /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 18:03:36.138591 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-79fe381f-fcd0-44a1-8383-b57690633d6e tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "DELETE /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7/os-volume_attachments/99404906-ad4c-45bb-974d-652d2d4880e6" status: 202 len: 0 microversion: 2.1 time: 0.186811 Jul 14 18:03:36.139248 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 541/1039] 10.222.0.64 () {58 vars in 1415 bytes} [Thu Jul 14 18:03:35 2022] DELETE /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7/os-volume_attachments/99404906-ad4c-45bb-974d-652d2d4880e6 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 18:03:37.109446 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-31e92f15-db4a-41bb-a061-37a2eed62536 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:37.110072 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-31e92f15-db4a-41bb-a061-37a2eed62536 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: b365d72e-49c5-4ad5-a92a-0e2de1580bbf] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:37.117951 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-31e92f15-db4a-41bb-a061-37a2eed62536 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:37.118395 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-31e92f15-db4a-41bb-a061-37a2eed62536 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:37.119168 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-31e92f15-db4a-41bb-a061-37a2eed62536 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:37.119607 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-31e92f15-db4a-41bb-a061-37a2eed62536 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:37.183475 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-31e92f15-db4a-41bb-a061-37a2eed62536 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dd1356e5bc4d35aca1bf1edf6f2140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ce085523d84754b8d107b5c0936491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:03:37.190934 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-31e92f15-db4a-41bb-a061-37a2eed62536 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "GET /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf" status: 200 len: 1270 microversion: 2.1 time: 0.085428 Jul 14 18:03:37.191506 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 499/1040] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:03:37 2022] GET /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf => generated 1270 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:03:37.302096 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-9f203282-a090-4ea1-b3d6-59808fd46204 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:37.303111 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-9f203282-a090-4ea1-b3d6-59808fd46204 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: c25aaf9b-059d-4605-8607-8810702e9ee7] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:37.309943 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9f203282-a090-4ea1-b3d6-59808fd46204 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:37.310394 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9f203282-a090-4ea1-b3d6-59808fd46204 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:37.311182 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9f203282-a090-4ea1-b3d6-59808fd46204 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:37.311624 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9f203282-a090-4ea1-b3d6-59808fd46204 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:37.348863 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-9f203282-a090-4ea1-b3d6-59808fd46204 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051425 Jul 14 18:03:37.349740 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 542/1041] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Jul 14 18:03:37 2022] GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:03:38.208770 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-1c87d133-cdb4-488c-888c-2c40f1697d3a tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:38.209392 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-1c87d133-cdb4-488c-888c-2c40f1697d3a tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: b365d72e-49c5-4ad5-a92a-0e2de1580bbf] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:38.216850 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1c87d133-cdb4-488c-888c-2c40f1697d3a tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:38.217308 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1c87d133-cdb4-488c-888c-2c40f1697d3a tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:38.218091 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1c87d133-cdb4-488c-888c-2c40f1697d3a tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:38.218791 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1c87d133-cdb4-488c-888c-2c40f1697d3a tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:38.223369 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:03:38.356184 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-1c87d133-cdb4-488c-888c-2c40f1697d3a tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dd1356e5bc4d35aca1bf1edf6f2140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ce085523d84754b8d107b5c0936491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:03:38.361597 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-b76d1f92-90e0-4c11-926c-fcb8e0d997e2 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:38.362607 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-b76d1f92-90e0-4c11-926c-fcb8e0d997e2 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: c25aaf9b-059d-4605-8607-8810702e9ee7] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:38.364575 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-1c87d133-cdb4-488c-888c-2c40f1697d3a tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "GET /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf" status: 200 len: 1318 microversion: 2.1 time: 0.159532 Jul 14 18:03:38.367963 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 500/1042] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:03:38 2022] GET /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:03:38.370009 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b76d1f92-90e0-4c11-926c-fcb8e0d997e2 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:38.370551 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b76d1f92-90e0-4c11-926c-fcb8e0d997e2 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:38.371430 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b76d1f92-90e0-4c11-926c-fcb8e0d997e2 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:38.371958 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b76d1f92-90e0-4c11-926c-fcb8e0d997e2 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:38.403369 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-b76d1f92-90e0-4c11-926c-fcb8e0d997e2 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045877 Jul 14 18:03:38.404031 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 543/1043] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Jul 14 18:03:38 2022] GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 18:03:38.510804 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-e0b759b4-b08d-43a7-b97f-361122a51dc2 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:38.511788 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-e0b759b4-b08d-43a7-b97f-361122a51dc2 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: c25aaf9b-059d-4605-8607-8810702e9ee7] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:38.517824 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e0b759b4-b08d-43a7-b97f-361122a51dc2 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:38.518326 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e0b759b4-b08d-43a7-b97f-361122a51dc2 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:38.519180 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e0b759b4-b08d-43a7-b97f-361122a51dc2 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:38.519725 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e0b759b4-b08d-43a7-b97f-361122a51dc2 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:38.549250 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-e0b759b4-b08d-43a7-b97f-361122a51dc2 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042854 Jul 14 18:03:38.549810 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 501/1044] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Jul 14 18:03:38 2022] GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 18:03:38.609919 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-6736dad3-40a0-4d93-bc63-7484bf155d91 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:38.610379 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-6736dad3-40a0-4d93-bc63-7484bf155d91 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: c25aaf9b-059d-4605-8607-8810702e9ee7] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:38.617073 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6736dad3-40a0-4d93-bc63-7484bf155d91 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:38.617513 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6736dad3-40a0-4d93-bc63-7484bf155d91 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:38.618279 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6736dad3-40a0-4d93-bc63-7484bf155d91 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:38.618712 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6736dad3-40a0-4d93-bc63-7484bf155d91 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:38.643865 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-6736dad3-40a0-4d93-bc63-7484bf155d91 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: c25aaf9b-059d-4605-8607-8810702e9ee7] Going to try to terminate instance {{(pid=129471) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 18:03:38.695762 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:03:38.727315 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-6736dad3-40a0-4d93-bc63-7484bf155d91 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "DELETE /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7" status: 204 len: 0 microversion: 2.1 time: 0.121016 Jul 14 18:03:38.728346 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 544/1045] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Jul 14 18:03:38 2022] DELETE /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 18:03:38.737047 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-d30f0875-5993-489a-a26d-a868c6ec6041 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:38.737812 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-d30f0875-5993-489a-a26d-a868c6ec6041 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: c25aaf9b-059d-4605-8607-8810702e9ee7] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:38.745376 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d30f0875-5993-489a-a26d-a868c6ec6041 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:38.745952 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d30f0875-5993-489a-a26d-a868c6ec6041 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:38.746817 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d30f0875-5993-489a-a26d-a868c6ec6041 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:38.747317 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d30f0875-5993-489a-a26d-a868c6ec6041 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:38.888571 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-d30f0875-5993-489a-a26d-a868c6ec6041 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:03:38.896441 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-d30f0875-5993-489a-a26d-a868c6ec6041 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7" status: 200 len: 1670 microversion: 2.1 time: 0.163458 Jul 14 18:03:38.896987 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 502/1046] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:03:38 2022] GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7 => generated 1670 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:03:39.061340 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [req-839f18c2-6192-41d9-9e92-c3fc21545b73 req-0755befb-5d27-425d-b0e6-4af9bf7c5d08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b365d72e-49c5-4ad5-a92a-0e2de1580bbf", "tag": "06d59003-e8af-4084-9c62-e9bd38fe4c28"}]} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:03:39.076435 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-839f18c2-6192-41d9-9e92-c3fc21545b73 req-0755befb-5d27-425d-b0e6-4af9bf7c5d08 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:39.077120 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-839f18c2-6192-41d9-9e92-c3fc21545b73 req-0755befb-5d27-425d-b0e6-4af9bf7c5d08 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:39.095152 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.compute.server_external_events [req-839f18c2-6192-41d9-9e92-c3fc21545b73 req-0755befb-5d27-425d-b0e6-4af9bf7c5d08 service nova] Creating event network-changed:06d59003-e8af-4084-9c62-e9bd38fe4c28 for instance b365d72e-49c5-4ad5-a92a-0e2de1580bbf on hv-cinder-84989 Jul 14 18:03:39.100887 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [req-839f18c2-6192-41d9-9e92-c3fc21545b73 req-0755befb-5d27-425d-b0e6-4af9bf7c5d08 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043573 Jul 14 18:03:39.101578 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 545/1047] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:03:39.383341 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-33add6ff-c72e-4316-90a0-a5062bd54c51 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:39.384175 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-33add6ff-c72e-4316-90a0-a5062bd54c51 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: b365d72e-49c5-4ad5-a92a-0e2de1580bbf] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:39.390654 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-33add6ff-c72e-4316-90a0-a5062bd54c51 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:39.391109 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-33add6ff-c72e-4316-90a0-a5062bd54c51 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:39.391916 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-33add6ff-c72e-4316-90a0-a5062bd54c51 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:39.392380 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-33add6ff-c72e-4316-90a0-a5062bd54c51 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:39.524841 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-33add6ff-c72e-4316-90a0-a5062bd54c51 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dd1356e5bc4d35aca1bf1edf6f2140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ce085523d84754b8d107b5c0936491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:03:39.532514 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-33add6ff-c72e-4316-90a0-a5062bd54c51 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "GET /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf" status: 200 len: 1318 microversion: 2.1 time: 0.153633 Jul 14 18:03:39.533091 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 503/1048] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:03:39 2022] GET /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:03:39.914863 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-e66ea10f-df7c-40cb-84c1-73376b9a8690 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:39.915485 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-e66ea10f-df7c-40cb-84c1-73376b9a8690 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: c25aaf9b-059d-4605-8607-8810702e9ee7] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:39.923144 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e66ea10f-df7c-40cb-84c1-73376b9a8690 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:39.923603 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e66ea10f-df7c-40cb-84c1-73376b9a8690 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:39.924416 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e66ea10f-df7c-40cb-84c1-73376b9a8690 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:39.924871 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e66ea10f-df7c-40cb-84c1-73376b9a8690 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:40.060369 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-e66ea10f-df7c-40cb-84c1-73376b9a8690 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:03:40.068302 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-e66ea10f-df7c-40cb-84c1-73376b9a8690 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7" status: 200 len: 1670 microversion: 2.1 time: 0.158111 Jul 14 18:03:40.069443 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 546/1049] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:03:39 2022] GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7 => generated 1670 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:03:40.550036 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-8832686d-764e-4582-a608-8acd79c6f0e1 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:40.550710 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-8832686d-764e-4582-a608-8acd79c6f0e1 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: b365d72e-49c5-4ad5-a92a-0e2de1580bbf] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:40.558815 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8832686d-764e-4582-a608-8acd79c6f0e1 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:40.559268 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8832686d-764e-4582-a608-8acd79c6f0e1 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:40.560092 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8832686d-764e-4582-a608-8acd79c6f0e1 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:40.560540 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8832686d-764e-4582-a608-8acd79c6f0e1 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:40.702286 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-8832686d-764e-4582-a608-8acd79c6f0e1 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dd1356e5bc4d35aca1bf1edf6f2140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ce085523d84754b8d107b5c0936491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:03:40.711473 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-8832686d-764e-4582-a608-8acd79c6f0e1 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "GET /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf" status: 200 len: 1318 microversion: 2.1 time: 0.164973 Jul 14 18:03:40.712351 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 504/1050] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:03:40 2022] GET /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:03:41.087510 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-da8995b4-45ae-4aa4-97fd-992836c0309c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:41.088179 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-da8995b4-45ae-4aa4-97fd-992836c0309c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: c25aaf9b-059d-4605-8607-8810702e9ee7] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:41.095315 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-da8995b4-45ae-4aa4-97fd-992836c0309c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:41.095793 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-da8995b4-45ae-4aa4-97fd-992836c0309c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:41.096608 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-da8995b4-45ae-4aa4-97fd-992836c0309c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:41.097051 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-da8995b4-45ae-4aa4-97fd-992836c0309c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:41.239937 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-da8995b4-45ae-4aa4-97fd-992836c0309c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:03:41.247734 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-da8995b4-45ae-4aa4-97fd-992836c0309c tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7" status: 200 len: 1670 microversion: 2.1 time: 0.164610 Jul 14 18:03:41.248352 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 547/1051] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:03:41 2022] GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7 => generated 1670 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:03:41.729062 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-b188015e-71b9-4945-85ec-28ae215ca9a4 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:41.729668 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-b188015e-71b9-4945-85ec-28ae215ca9a4 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: b365d72e-49c5-4ad5-a92a-0e2de1580bbf] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:41.736455 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b188015e-71b9-4945-85ec-28ae215ca9a4 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:41.736914 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b188015e-71b9-4945-85ec-28ae215ca9a4 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:41.737712 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b188015e-71b9-4945-85ec-28ae215ca9a4 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:41.738154 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b188015e-71b9-4945-85ec-28ae215ca9a4 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:41.883746 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-b188015e-71b9-4945-85ec-28ae215ca9a4 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dd1356e5bc4d35aca1bf1edf6f2140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ce085523d84754b8d107b5c0936491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:03:41.891721 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-b188015e-71b9-4945-85ec-28ae215ca9a4 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "GET /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf" status: 200 len: 1318 microversion: 2.1 time: 0.166581 Jul 14 18:03:41.892785 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 505/1052] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:03:41 2022] GET /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:03:42.265660 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-a6d61ec9-62c3-4ccd-87c8-03f099eb5bbf tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:42.266974 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-a6d61ec9-62c3-4ccd-87c8-03f099eb5bbf tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: c25aaf9b-059d-4605-8607-8810702e9ee7] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:42.277595 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a6d61ec9-62c3-4ccd-87c8-03f099eb5bbf tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:42.278040 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a6d61ec9-62c3-4ccd-87c8-03f099eb5bbf tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:42.279018 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a6d61ec9-62c3-4ccd-87c8-03f099eb5bbf tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:42.279453 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a6d61ec9-62c3-4ccd-87c8-03f099eb5bbf tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:42.340654 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-e00c112a-269a-4257-9a6a-97b4b3375b01 req-0ce9b56f-d5b6-4b51-83ef-c8c60a1dbfa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c25aaf9b-059d-4605-8607-8810702e9ee7", "name": "network-vif-deleted", "tag": "55ac38e4-f540-4ccf-a87b-fa51764aa743"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:03:42.351389 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-e00c112a-269a-4257-9a6a-97b4b3375b01 req-0ce9b56f-d5b6-4b51-83ef-c8c60a1dbfa2 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:42.352168 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-e00c112a-269a-4257-9a6a-97b4b3375b01 req-0ce9b56f-d5b6-4b51-83ef-c8c60a1dbfa2 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:42.352322 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-a6d61ec9-62c3-4ccd-87c8-03f099eb5bbf tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:03:42.363196 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-a6d61ec9-62c3-4ccd-87c8-03f099eb5bbf tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7" status: 200 len: 1604 microversion: 2.1 time: 0.101308 Jul 14 18:03:42.366981 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 548/1053] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:03:42 2022] GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7 => generated 1604 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:03:42.367827 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-e00c112a-269a-4257-9a6a-97b4b3375b01 req-0ce9b56f-d5b6-4b51-83ef-c8c60a1dbfa2 service nova] Creating event network-vif-deleted:55ac38e4-f540-4ccf-a87b-fa51764aa743 for instance c25aaf9b-059d-4605-8607-8810702e9ee7 on hv-cinder-84989 Jul 14 18:03:42.382791 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-e00c112a-269a-4257-9a6a-97b4b3375b01 req-0ce9b56f-d5b6-4b51-83ef-c8c60a1dbfa2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045970 Jul 14 18:03:42.384115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 506/1054] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 18:03:42.916485 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-67393ea3-fd1d-4f98-9072-2ce899552c25 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:42.917098 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-67393ea3-fd1d-4f98-9072-2ce899552c25 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: b365d72e-49c5-4ad5-a92a-0e2de1580bbf] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:42.923650 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-67393ea3-fd1d-4f98-9072-2ce899552c25 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:42.924230 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-67393ea3-fd1d-4f98-9072-2ce899552c25 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:42.925091 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-67393ea3-fd1d-4f98-9072-2ce899552c25 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:42.925678 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-67393ea3-fd1d-4f98-9072-2ce899552c25 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:43.077012 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-67393ea3-fd1d-4f98-9072-2ce899552c25 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dd1356e5bc4d35aca1bf1edf6f2140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ce085523d84754b8d107b5c0936491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:03:43.085868 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-67393ea3-fd1d-4f98-9072-2ce899552c25 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "GET /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf" status: 200 len: 1318 microversion: 2.1 time: 0.173251 Jul 14 18:03:43.086459 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 549/1055] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:03:42 2022] GET /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:03:43.392369 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-dc6e362a-33c0-49a2-b44a-a8060195d952 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:43.393534 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-dc6e362a-33c0-49a2-b44a-a8060195d952 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: c25aaf9b-059d-4605-8607-8810702e9ee7] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:43.402773 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-dc6e362a-33c0-49a2-b44a-a8060195d952 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:43.403547 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-dc6e362a-33c0-49a2-b44a-a8060195d952 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:43.405443 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-dc6e362a-33c0-49a2-b44a-a8060195d952 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:43.405443 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-dc6e362a-33c0-49a2-b44a-a8060195d952 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:43.474067 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-dc6e362a-33c0-49a2-b44a-a8060195d952 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:03:43.485104 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-dc6e362a-33c0-49a2-b44a-a8060195d952 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7" status: 200 len: 1604 microversion: 2.1 time: 0.097198 Jul 14 18:03:43.486438 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 507/1056] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:03:43 2022] GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7 => generated 1604 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 18:03:43.646120 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 18:03:43.646730 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Thu Jul 14 18:03:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 18:03:44.103482 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-c1bbf1e8-7da4-4c20-a7b5-c9e1dbc1fd78 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:44.104126 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-c1bbf1e8-7da4-4c20-a7b5-c9e1dbc1fd78 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: b365d72e-49c5-4ad5-a92a-0e2de1580bbf] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:44.110778 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c1bbf1e8-7da4-4c20-a7b5-c9e1dbc1fd78 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:44.111218 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c1bbf1e8-7da4-4c20-a7b5-c9e1dbc1fd78 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:44.112023 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c1bbf1e8-7da4-4c20-a7b5-c9e1dbc1fd78 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:44.112460 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c1bbf1e8-7da4-4c20-a7b5-c9e1dbc1fd78 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:44.243678 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-c1bbf1e8-7da4-4c20-a7b5-c9e1dbc1fd78 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dd1356e5bc4d35aca1bf1edf6f2140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ce085523d84754b8d107b5c0936491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:03:44.251276 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-c1bbf1e8-7da4-4c20-a7b5-c9e1dbc1fd78 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "GET /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf" status: 200 len: 1318 microversion: 2.1 time: 0.152418 Jul 14 18:03:44.251838 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 550/1057] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:03:44 2022] GET /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:03:44.508585 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-ab2e2a21-bb0d-4586-8935-626bfac9c675 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:44.509199 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-ab2e2a21-bb0d-4586-8935-626bfac9c675 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: c25aaf9b-059d-4605-8607-8810702e9ee7] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:44.516254 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ab2e2a21-bb0d-4586-8935-626bfac9c675 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:44.516705 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ab2e2a21-bb0d-4586-8935-626bfac9c675 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:44.517471 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ab2e2a21-bb0d-4586-8935-626bfac9c675 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:44.517903 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ab2e2a21-bb0d-4586-8935-626bfac9c675 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:44.587614 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-ab2e2a21-bb0d-4586-8935-626bfac9c675 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c38f6ff5af4ba79c80fb581baacb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51408d5653d460f82009b65e238281f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:03:44.595472 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-ab2e2a21-bb0d-4586-8935-626bfac9c675 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7" status: 200 len: 1604 microversion: 2.1 time: 0.091633 Jul 14 18:03:44.596068 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 508/1058] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:03:44 2022] GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7 => generated 1604 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 18:03:45.268832 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-a3233fef-ca67-43cd-b2f4-71eeee92d0b0 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:45.269381 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-a3233fef-ca67-43cd-b2f4-71eeee92d0b0 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: b365d72e-49c5-4ad5-a92a-0e2de1580bbf] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:45.278513 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a3233fef-ca67-43cd-b2f4-71eeee92d0b0 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:45.278972 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a3233fef-ca67-43cd-b2f4-71eeee92d0b0 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:45.279766 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a3233fef-ca67-43cd-b2f4-71eeee92d0b0 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:45.280242 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a3233fef-ca67-43cd-b2f4-71eeee92d0b0 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:45.413770 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-a3233fef-ca67-43cd-b2f4-71eeee92d0b0 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dd1356e5bc4d35aca1bf1edf6f2140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ce085523d84754b8d107b5c0936491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:03:45.425329 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-a3233fef-ca67-43cd-b2f4-71eeee92d0b0 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "GET /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf" status: 200 len: 1318 microversion: 2.1 time: 0.160385 Jul 14 18:03:45.425922 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 551/1059] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:03:45 2022] GET /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:03:45.612735 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-e75c0398-c27d-4f60-a2af-956d1cacc364 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:45.613390 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-e75c0398-c27d-4f60-a2af-956d1cacc364 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: c25aaf9b-059d-4605-8607-8810702e9ee7] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:45.620146 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e75c0398-c27d-4f60-a2af-956d1cacc364 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:45.620610 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e75c0398-c27d-4f60-a2af-956d1cacc364 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:45.621388 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e75c0398-c27d-4f60-a2af-956d1cacc364 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:45.621828 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e75c0398-c27d-4f60-a2af-956d1cacc364 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:45.636788 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.wsgi [None req-e75c0398-c27d-4f60-a2af-956d1cacc364 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] HTTP exception thrown: Instance c25aaf9b-059d-4605-8607-8810702e9ee7 could not be found. Jul 14 18:03:45.638502 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-e75c0398-c27d-4f60-a2af-956d1cacc364 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Request method failure captured: Jul 14 18:03:45.638502 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: request: GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7 HTTP/1.1 Jul 14 18:03:45.638502 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept: application/json Jul 14 18:03:45.638502 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept-Encoding: identity Jul 14 18:03:45.638502 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Connection: close Jul 14 18:03:45.638502 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Length: 0 Jul 14 18:03:45.638502 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Type: application/json Jul 14 18:03:45.638502 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Host: 10.222.0.64 Jul 14 18:03:45.638502 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Openstack-System-Scope: None Jul 14 18:03:45.638502 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: User-Agent: python-urllib3/1.26.9 Jul 14 18:03:45.638502 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Auth-Token: gAAAAABi0FfHvR6PpIhkosQ1X7_9NpTPXG5F1g5Xt3oqAF0Fb1smJZRvXMYjeWtOXuLV8qjGuJGvzKJ_Q6ZOWEKnG6CONblT1ibngkmWiXLgdhBRRvy0OiDg3hLogpV8lb8YjEQnCidxPy7H0uj1770GzHRBkq97CkOGykDSSpF5meH0d4NIoBA Jul 14 18:03:45.638502 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Id: None Jul 14 18:03:45.638502 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Name: None Jul 14 18:03:45.638502 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Identity-Status: Confirmed Jul 14 18:03:45.638502 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Is-Admin-Project: True Jul 14 18:03:45.638502 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Id: default Jul 14 18:03:45.638502 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Name: Default Jul 14 18:03:45.638502 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Id: e51408d5653d460f82009b65e238281f Jul 14 18:03:45.638502 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Name: tempest-AttachVolumeTestJSON-564883252 Jul 14 18:03:45.638502 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Role: reader,member Jul 14 18:03:45.638502 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Roles: reader,member Jul 14 18:03:45.640127 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e51408d5653d460f82009b65e238281f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e51408d5653d460f82009b65e238281f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e51408d5653d460f82009b65e238281f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e51408d5653d460f82009b65e238281f", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:03:45.640127 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant: tempest-AttachVolumeTestJSON-564883252 Jul 14 18:03:45.640127 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Id: e51408d5653d460f82009b65e238281f Jul 14 18:03:45.640127 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Name: tempest-AttachVolumeTestJSON-564883252 Jul 14 18:03:45.640127 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User: tempest-AttachVolumeTestJSON-564883252-project Jul 14 18:03:45.640127 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Id: default Jul 14 18:03:45.640127 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Name: Default Jul 14 18:03:45.640127 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Id: 84c38f6ff5af4ba79c80fb581baacb0b Jul 14 18:03:45.640127 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Name: tempest-AttachVolumeTestJSON-564883252-project Jul 14 18:03:45.640127 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: method: > Jul 14 18:03:45.640127 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: exception: Instance c25aaf9b-059d-4605-8607-8810702e9ee7 could not be found. Jul 14 18:03:45.640127 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: action_args: {'id': 'c25aaf9b-059d-4605-8607-8810702e9ee7'} Jul 14 18:03:45.641088 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:03:45.641088 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:03:45.641088 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 18:03:45.641088 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 18:03:45.641088 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 18:03:45.641088 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 18:03:45.641088 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 18:03:45.641088 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 18:03:45.641088 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 18:03:45.641088 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 18:03:45.641088 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c25aaf9b-059d-4605-8607-8810702e9ee7 could not be found. Jul 14 18:03:45.641088 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:03:45.641088 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:03:45.641088 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:03:45.641088 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:03:45.641088 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:03:45.641088 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:03:45.641088 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:03:45.641088 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:03:45.641088 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:03:45.642869 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:03:45.642869 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 18:03:45.642869 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 18:03:45.642869 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 18:03:45.642869 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 18:03:45.642869 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 18:03:45.642869 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 18:03:45.642869 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c25aaf9b-059d-4605-8607-8810702e9ee7 could not be found. Jul 14 18:03:45.642869 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:03:45.642869 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:03:45.642869 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:03:45.642869 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:03:45.642869 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:03:45.642869 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:03:45.642869 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 18:03:45.642869 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 18:03:45.642869 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c25aaf9b-059d-4605-8607-8810702e9ee7 could not be found. Jul 14 18:03:45.642869 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:03:45.644674 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-e75c0398-c27d-4f60-a2af-956d1cacc364 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Returning 404 to user: Instance c25aaf9b-059d-4605-8607-8810702e9ee7 could not be found. {{(pid=129470) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:03:45.644674 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-e75c0398-c27d-4f60-a2af-956d1cacc364 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7" status: 404 len: 111 microversion: 2.1 time: 0.031354 Jul 14 18:03:45.644674 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 509/1060] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:03:45 2022] GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 18:03:45.649686 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-4517c86d-ca66-4d45-b19a-436fd2c72d9f tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '.version_select at 0x7f138007f310>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:45.653097 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4517c86d-ca66-4d45-b19a-436fd2c72d9f tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [ba199572-6773-47d4-985d-104d03143ae9] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 18:03:46.442253 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-fc1f0304-ae25-4fe4-a2aa-dc58f2a3d8b6 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:46.442869 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-fc1f0304-ae25-4fe4-a2aa-dc58f2a3d8b6 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: b365d72e-49c5-4ad5-a92a-0e2de1580bbf] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:46.444897 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell0:SELECT=2 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:03:46.445565 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell0:SELECT=8 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:03:46.452261 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fc1f0304-ae25-4fe4-a2aa-dc58f2a3d8b6 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:46.452716 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fc1f0304-ae25-4fe4-a2aa-dc58f2a3d8b6 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:46.453506 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fc1f0304-ae25-4fe4-a2aa-dc58f2a3d8b6 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:46.453954 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fc1f0304-ae25-4fe4-a2aa-dc58f2a3d8b6 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:46.588579 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-fc1f0304-ae25-4fe4-a2aa-dc58f2a3d8b6 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dd1356e5bc4d35aca1bf1edf6f2140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ce085523d84754b8d107b5c0936491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:03:46.600341 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-fc1f0304-ae25-4fe4-a2aa-dc58f2a3d8b6 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "GET /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf" status: 200 len: 1318 microversion: 2.1 time: 0.161590 Jul 14 18:03:46.600920 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 510/1061] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:03:46 2022] GET /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 18:03:46.660594 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO oslo.messaging._drivers.impl_rabbit [None req-4517c86d-ca66-4d45-b19a-436fd2c72d9f tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [ba199572-6773-47d4-985d-104d03143ae9] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 36698. Jul 14 18:03:46.668435 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:03:46.682345 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-4517c86d-ca66-4d45-b19a-436fd2c72d9f tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-914657154" status: 202 len: 0 microversion: 2.1 time: 1.036906 Jul 14 18:03:46.682850 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 552/1062] 10.222.0.64 () {58 vars in 1217 bytes} [Thu Jul 14 18:03:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-914657154 => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 18:03:47.077569 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-40f4f4d8-103d-44ee-8156-c9bc8a2bd610 req-0fa84633-a9f9-4164-93d3-29e838a66daf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b365d72e-49c5-4ad5-a92a-0e2de1580bbf", "name": "network-vif-plugged", "status": "completed", "tag": "06d59003-e8af-4084-9c62-e9bd38fe4c28"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:03:47.089415 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-40f4f4d8-103d-44ee-8156-c9bc8a2bd610 req-0fa84633-a9f9-4164-93d3-29e838a66daf service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:47.090171 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-40f4f4d8-103d-44ee-8156-c9bc8a2bd610 req-0fa84633-a9f9-4164-93d3-29e838a66daf service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:47.103773 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-40f4f4d8-103d-44ee-8156-c9bc8a2bd610 req-0fa84633-a9f9-4164-93d3-29e838a66daf service nova] Creating event network-vif-plugged:06d59003-e8af-4084-9c62-e9bd38fe4c28 for instance b365d72e-49c5-4ad5-a92a-0e2de1580bbf on hv-cinder-84989 Jul 14 18:03:47.111270 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-40f4f4d8-103d-44ee-8156-c9bc8a2bd610 req-0fa84633-a9f9-4164-93d3-29e838a66daf service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110367 Jul 14 18:03:47.111869 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 511/1063] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:03:47.618630 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-066c5aba-f144-45bf-a72f-1f4af6caa88a tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:47.619264 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-066c5aba-f144-45bf-a72f-1f4af6caa88a tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: b365d72e-49c5-4ad5-a92a-0e2de1580bbf] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:47.626698 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-066c5aba-f144-45bf-a72f-1f4af6caa88a tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:47.627155 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-066c5aba-f144-45bf-a72f-1f4af6caa88a tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:47.627987 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-066c5aba-f144-45bf-a72f-1f4af6caa88a tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:47.628442 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-066c5aba-f144-45bf-a72f-1f4af6caa88a tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:47.764069 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-066c5aba-f144-45bf-a72f-1f4af6caa88a tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dd1356e5bc4d35aca1bf1edf6f2140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ce085523d84754b8d107b5c0936491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:03:47.775870 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-066c5aba-f144-45bf-a72f-1f4af6caa88a tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "GET /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf" status: 200 len: 1318 microversion: 2.1 time: 0.162458 Jul 14 18:03:47.776398 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 553/1064] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:03:47 2022] GET /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:03:48.793668 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-b4c44d91-1af9-4fab-b695-8c731e8e370e tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:48.794361 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-b4c44d91-1af9-4fab-b695-8c731e8e370e tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: b365d72e-49c5-4ad5-a92a-0e2de1580bbf] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:48.800636 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b4c44d91-1af9-4fab-b695-8c731e8e370e tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:48.801086 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b4c44d91-1af9-4fab-b695-8c731e8e370e tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:48.801846 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b4c44d91-1af9-4fab-b695-8c731e8e370e tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:48.802287 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b4c44d91-1af9-4fab-b695-8c731e8e370e tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:48.952324 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-b4c44d91-1af9-4fab-b695-8c731e8e370e tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dd1356e5bc4d35aca1bf1edf6f2140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ce085523d84754b8d107b5c0936491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:03:48.961541 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-b4c44d91-1af9-4fab-b695-8c731e8e370e tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "GET /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf" status: 200 len: 1318 microversion: 2.1 time: 0.172464 Jul 14 18:03:48.962209 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 512/1065] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:03:48 2022] GET /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:03:49.761281 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-9ce05672-ad71-4c58-8943-73b17035aa54 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:49.761842 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-9ce05672-ad71-4c58-8943-73b17035aa54 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: c25aaf9b-059d-4605-8607-8810702e9ee7] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:49.768651 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9ce05672-ad71-4c58-8943-73b17035aa54 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:49.769109 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9ce05672-ad71-4c58-8943-73b17035aa54 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:49.770408 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9ce05672-ad71-4c58-8943-73b17035aa54 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:49.770851 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9ce05672-ad71-4c58-8943-73b17035aa54 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:49.785854 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.wsgi [None req-9ce05672-ad71-4c58-8943-73b17035aa54 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] HTTP exception thrown: Instance c25aaf9b-059d-4605-8607-8810702e9ee7 could not be found. Jul 14 18:03:49.787705 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-9ce05672-ad71-4c58-8943-73b17035aa54 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Request method failure captured: Jul 14 18:03:49.787705 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: request: DELETE /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7 HTTP/1.1 Jul 14 18:03:49.787705 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept: application/json Jul 14 18:03:49.787705 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept-Encoding: identity Jul 14 18:03:49.787705 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Connection: close Jul 14 18:03:49.787705 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Length: 0 Jul 14 18:03:49.787705 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Type: application/json Jul 14 18:03:49.787705 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Host: 10.222.0.64 Jul 14 18:03:49.787705 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Openstack-System-Scope: None Jul 14 18:03:49.787705 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: User-Agent: python-urllib3/1.26.9 Jul 14 18:03:49.787705 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Auth-Token: gAAAAABi0FfHvR6PpIhkosQ1X7_9NpTPXG5F1g5Xt3oqAF0Fb1smJZRvXMYjeWtOXuLV8qjGuJGvzKJ_Q6ZOWEKnG6CONblT1ibngkmWiXLgdhBRRvy0OiDg3hLogpV8lb8YjEQnCidxPy7H0uj1770GzHRBkq97CkOGykDSSpF5meH0d4NIoBA Jul 14 18:03:49.787705 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Id: None Jul 14 18:03:49.787705 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Name: None Jul 14 18:03:49.787705 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Identity-Status: Confirmed Jul 14 18:03:49.787705 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Is-Admin-Project: True Jul 14 18:03:49.787705 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Id: default Jul 14 18:03:49.787705 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Name: Default Jul 14 18:03:49.787705 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Id: e51408d5653d460f82009b65e238281f Jul 14 18:03:49.787705 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Name: tempest-AttachVolumeTestJSON-564883252 Jul 14 18:03:49.787705 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Role: reader,member Jul 14 18:03:49.787705 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Roles: reader,member Jul 14 18:03:49.789382 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e51408d5653d460f82009b65e238281f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e51408d5653d460f82009b65e238281f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e51408d5653d460f82009b65e238281f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e51408d5653d460f82009b65e238281f", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:03:49.789382 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant: tempest-AttachVolumeTestJSON-564883252 Jul 14 18:03:49.789382 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Id: e51408d5653d460f82009b65e238281f Jul 14 18:03:49.789382 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Name: tempest-AttachVolumeTestJSON-564883252 Jul 14 18:03:49.789382 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User: tempest-AttachVolumeTestJSON-564883252-project Jul 14 18:03:49.789382 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Id: default Jul 14 18:03:49.789382 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Name: Default Jul 14 18:03:49.789382 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Id: 84c38f6ff5af4ba79c80fb581baacb0b Jul 14 18:03:49.789382 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Name: tempest-AttachVolumeTestJSON-564883252-project Jul 14 18:03:49.789382 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: method: > Jul 14 18:03:49.789382 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: exception: Instance c25aaf9b-059d-4605-8607-8810702e9ee7 could not be found. Jul 14 18:03:49.789382 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: action_args: {'id': 'c25aaf9b-059d-4605-8607-8810702e9ee7'} Jul 14 18:03:49.790340 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:03:49.790340 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:03:49.790340 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 18:03:49.790340 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 18:03:49.790340 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 18:03:49.790340 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 18:03:49.790340 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 18:03:49.790340 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 18:03:49.790340 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 18:03:49.790340 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 18:03:49.790340 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c25aaf9b-059d-4605-8607-8810702e9ee7 could not be found. Jul 14 18:03:49.790340 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:03:49.790340 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:03:49.790340 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:03:49.790340 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:03:49.790340 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:03:49.790340 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:03:49.790340 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:03:49.790340 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:03:49.790340 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:03:49.791808 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:03:49.791808 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 18:03:49.791808 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 18:03:49.791808 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 18:03:49.791808 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 18:03:49.791808 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 18:03:49.791808 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 18:03:49.791808 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 18:03:49.791808 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 18:03:49.791808 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c25aaf9b-059d-4605-8607-8810702e9ee7 could not be found. Jul 14 18:03:49.791808 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:03:49.791808 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:03:49.791808 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:03:49.791808 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:03:49.791808 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:03:49.791808 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:03:49.791808 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 18:03:49.791808 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 18:03:49.791808 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c25aaf9b-059d-4605-8607-8810702e9ee7 could not be found. Jul 14 18:03:49.791808 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:03:49.793625 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-9ce05672-ad71-4c58-8943-73b17035aa54 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Returning 404 to user: Instance c25aaf9b-059d-4605-8607-8810702e9ee7 could not be found. {{(pid=129471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:03:49.793625 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-9ce05672-ad71-4c58-8943-73b17035aa54 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "DELETE /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7" status: 404 len: 111 microversion: 2.1 time: 0.032165 Jul 14 18:03:49.793625 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 554/1066] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Jul 14 18:03:49 2022] DELETE /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 18:03:49.801450 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-a752f665-a301-4876-8176-b802bf92a415 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:49.802074 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-a752f665-a301-4876-8176-b802bf92a415 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: c25aaf9b-059d-4605-8607-8810702e9ee7] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:49.804582 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:03:49.810206 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a752f665-a301-4876-8176-b802bf92a415 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:49.810658 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a752f665-a301-4876-8176-b802bf92a415 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:49.811442 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a752f665-a301-4876-8176-b802bf92a415 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:49.811887 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a752f665-a301-4876-8176-b802bf92a415 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:49.828784 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.wsgi [None req-a752f665-a301-4876-8176-b802bf92a415 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] HTTP exception thrown: Instance c25aaf9b-059d-4605-8607-8810702e9ee7 could not be found. Jul 14 18:03:49.830516 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-a752f665-a301-4876-8176-b802bf92a415 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Request method failure captured: Jul 14 18:03:49.830516 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: request: GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7 HTTP/1.1 Jul 14 18:03:49.830516 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept: application/json Jul 14 18:03:49.830516 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept-Encoding: identity Jul 14 18:03:49.830516 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Connection: close Jul 14 18:03:49.830516 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Length: 0 Jul 14 18:03:49.830516 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Type: application/json Jul 14 18:03:49.830516 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Host: 10.222.0.64 Jul 14 18:03:49.830516 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Openstack-System-Scope: None Jul 14 18:03:49.830516 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: User-Agent: python-urllib3/1.26.9 Jul 14 18:03:49.830516 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Auth-Token: gAAAAABi0FfHvR6PpIhkosQ1X7_9NpTPXG5F1g5Xt3oqAF0Fb1smJZRvXMYjeWtOXuLV8qjGuJGvzKJ_Q6ZOWEKnG6CONblT1ibngkmWiXLgdhBRRvy0OiDg3hLogpV8lb8YjEQnCidxPy7H0uj1770GzHRBkq97CkOGykDSSpF5meH0d4NIoBA Jul 14 18:03:49.830516 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Id: None Jul 14 18:03:49.830516 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Name: None Jul 14 18:03:49.830516 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Identity-Status: Confirmed Jul 14 18:03:49.830516 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Is-Admin-Project: True Jul 14 18:03:49.830516 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Id: default Jul 14 18:03:49.830516 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Name: Default Jul 14 18:03:49.830516 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Id: e51408d5653d460f82009b65e238281f Jul 14 18:03:49.830516 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Name: tempest-AttachVolumeTestJSON-564883252 Jul 14 18:03:49.830516 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Role: reader,member Jul 14 18:03:49.830516 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Roles: reader,member Jul 14 18:03:49.832683 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e51408d5653d460f82009b65e238281f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e51408d5653d460f82009b65e238281f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e51408d5653d460f82009b65e238281f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e51408d5653d460f82009b65e238281f", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:03:49.832683 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant: tempest-AttachVolumeTestJSON-564883252 Jul 14 18:03:49.832683 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Id: e51408d5653d460f82009b65e238281f Jul 14 18:03:49.832683 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Name: tempest-AttachVolumeTestJSON-564883252 Jul 14 18:03:49.832683 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User: tempest-AttachVolumeTestJSON-564883252-project Jul 14 18:03:49.832683 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Id: default Jul 14 18:03:49.832683 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Name: Default Jul 14 18:03:49.832683 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Id: 84c38f6ff5af4ba79c80fb581baacb0b Jul 14 18:03:49.832683 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Name: tempest-AttachVolumeTestJSON-564883252-project Jul 14 18:03:49.832683 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: method: > Jul 14 18:03:49.832683 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: exception: Instance c25aaf9b-059d-4605-8607-8810702e9ee7 could not be found. Jul 14 18:03:49.832683 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: action_args: {'id': 'c25aaf9b-059d-4605-8607-8810702e9ee7'} Jul 14 18:03:49.833566 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:03:49.833566 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:03:49.833566 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 18:03:49.833566 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 18:03:49.833566 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 18:03:49.833566 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 18:03:49.833566 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 18:03:49.833566 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 18:03:49.833566 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 18:03:49.833566 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 18:03:49.833566 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c25aaf9b-059d-4605-8607-8810702e9ee7 could not be found. Jul 14 18:03:49.833566 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:03:49.833566 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:03:49.833566 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:03:49.833566 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:03:49.833566 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:03:49.833566 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:03:49.833566 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:03:49.833566 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:03:49.833566 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:03:49.834793 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:03:49.834793 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 18:03:49.834793 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 18:03:49.834793 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 18:03:49.834793 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 18:03:49.834793 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 18:03:49.834793 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 18:03:49.834793 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c25aaf9b-059d-4605-8607-8810702e9ee7 could not be found. Jul 14 18:03:49.834793 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:03:49.834793 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:03:49.834793 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:03:49.834793 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:03:49.834793 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:03:49.834793 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:03:49.834793 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 18:03:49.834793 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 18:03:49.834793 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c25aaf9b-059d-4605-8607-8810702e9ee7 could not be found. Jul 14 18:03:49.834793 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:03:49.836086 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-a752f665-a301-4876-8176-b802bf92a415 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Returning 404 to user: Instance c25aaf9b-059d-4605-8607-8810702e9ee7 could not be found. {{(pid=129470) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:03:49.836086 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-a752f665-a301-4876-8176-b802bf92a415 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7" status: 404 len: 111 microversion: 2.1 time: 0.036905 Jul 14 18:03:49.836086 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 513/1067] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:03:49 2022] GET /compute/v2.1/servers/c25aaf9b-059d-4605-8607-8810702e9ee7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 18:03:49.978847 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-10446397-d436-47dc-b813-16d0afe03db9 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:49.979579 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-10446397-d436-47dc-b813-16d0afe03db9 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: b365d72e-49c5-4ad5-a92a-0e2de1580bbf] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:49.986275 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-10446397-d436-47dc-b813-16d0afe03db9 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:49.986729 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-10446397-d436-47dc-b813-16d0afe03db9 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:49.987519 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-10446397-d436-47dc-b813-16d0afe03db9 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:49.987981 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-10446397-d436-47dc-b813-16d0afe03db9 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:50.123939 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-10446397-d436-47dc-b813-16d0afe03db9 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dd1356e5bc4d35aca1bf1edf6f2140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ce085523d84754b8d107b5c0936491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:03:50.132260 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-10446397-d436-47dc-b813-16d0afe03db9 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "GET /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf" status: 200 len: 1507 microversion: 2.1 time: 0.157247 Jul 14 18:03:50.132842 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 555/1068] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:03:49 2022] GET /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:03:50.149405 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-6a137078-f67f-420f-b8b5-11a22fcb5d8e tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46acb19a-50f5-488e-907d-10236309e4e7", "device": "/dev/sdb"}} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:03:50.150990 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-6a137078-f67f-420f-b8b5-11a22fcb5d8e tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: b365d72e-49c5-4ad5-a92a-0e2de1580bbf] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:50.157419 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6a137078-f67f-420f-b8b5-11a22fcb5d8e tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:50.157881 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6a137078-f67f-420f-b8b5-11a22fcb5d8e tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:50.158666 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6a137078-f67f-420f-b8b5-11a22fcb5d8e tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:50.159107 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6a137078-f67f-420f-b8b5-11a22fcb5d8e tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:50.421134 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-6a137078-f67f-420f-b8b5-11a22fcb5d8e tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "POST /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275235 Jul 14 18:03:50.421888 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 514/1069] 10.222.0.64 () {60 vars in 1322 bytes} [Thu Jul 14 18:03:50 2022] POST /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:03:50.982749 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-43c0e6a1-61af-4e8e-8a94-64115bf15eb8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:50.983362 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-43c0e6a1-61af-4e8e-8a94-64115bf15eb8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:50.990746 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-43c0e6a1-61af-4e8e-8a94-64115bf15eb8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:50.991199 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-43c0e6a1-61af-4e8e-8a94-64115bf15eb8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:50.992025 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-43c0e6a1-61af-4e8e-8a94-64115bf15eb8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:50.992482 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-43c0e6a1-61af-4e8e-8a94-64115bf15eb8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:51.007375 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.wsgi [None req-43c0e6a1-61af-4e8e-8a94-64115bf15eb8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] HTTP exception thrown: Instance 1e8e31fc-eea3-4666-90e3-1898f92cf6ba could not be found. Jul 14 18:03:51.009030 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-43c0e6a1-61af-4e8e-8a94-64115bf15eb8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Request method failure captured: Jul 14 18:03:51.009030 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: request: DELETE /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba HTTP/1.1 Jul 14 18:03:51.009030 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept: application/json Jul 14 18:03:51.009030 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept-Encoding: identity Jul 14 18:03:51.009030 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Connection: close Jul 14 18:03:51.009030 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Length: 0 Jul 14 18:03:51.009030 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Type: application/json Jul 14 18:03:51.009030 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Host: 10.222.0.64 Jul 14 18:03:51.009030 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Openstack-System-Scope: None Jul 14 18:03:51.009030 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: User-Agent: python-urllib3/1.26.9 Jul 14 18:03:51.009030 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Auth-Token: gAAAAABi0FfHvR6PpIhkosQ1X7_9NpTPXG5F1g5Xt3oqAF0Fb1smJZRvXMYjeWtOXuLV8qjGuJGvzKJ_Q6ZOWEKnG6CONblT1ibngkmWiXLgdhBRRvy0OiDg3hLogpV8lb8YjEQnCidxPy7H0uj1770GzHRBkq97CkOGykDSSpF5meH0d4NIoBA Jul 14 18:03:51.009030 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Id: None Jul 14 18:03:51.009030 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Name: None Jul 14 18:03:51.009030 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Identity-Status: Confirmed Jul 14 18:03:51.009030 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Is-Admin-Project: True Jul 14 18:03:51.009030 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Id: default Jul 14 18:03:51.009030 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Name: Default Jul 14 18:03:51.009030 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Id: e51408d5653d460f82009b65e238281f Jul 14 18:03:51.009030 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Name: tempest-AttachVolumeTestJSON-564883252 Jul 14 18:03:51.009030 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Role: reader,member Jul 14 18:03:51.009030 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Roles: reader,member Jul 14 18:03:51.011697 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e51408d5653d460f82009b65e238281f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e51408d5653d460f82009b65e238281f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e51408d5653d460f82009b65e238281f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e51408d5653d460f82009b65e238281f", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:03:51.011697 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant: tempest-AttachVolumeTestJSON-564883252 Jul 14 18:03:51.011697 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Id: e51408d5653d460f82009b65e238281f Jul 14 18:03:51.011697 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Name: tempest-AttachVolumeTestJSON-564883252 Jul 14 18:03:51.011697 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User: tempest-AttachVolumeTestJSON-564883252-project Jul 14 18:03:51.011697 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Id: default Jul 14 18:03:51.011697 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Name: Default Jul 14 18:03:51.011697 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Id: 84c38f6ff5af4ba79c80fb581baacb0b Jul 14 18:03:51.011697 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Name: tempest-AttachVolumeTestJSON-564883252-project Jul 14 18:03:51.011697 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: method: > Jul 14 18:03:51.011697 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: exception: Instance 1e8e31fc-eea3-4666-90e3-1898f92cf6ba could not be found. Jul 14 18:03:51.011697 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: action_args: {'id': '1e8e31fc-eea3-4666-90e3-1898f92cf6ba'} Jul 14 18:03:51.013251 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:03:51.013251 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:03:51.013251 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 18:03:51.013251 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 18:03:51.013251 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 18:03:51.013251 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 18:03:51.013251 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 18:03:51.013251 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 18:03:51.013251 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 18:03:51.013251 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 18:03:51.013251 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e8e31fc-eea3-4666-90e3-1898f92cf6ba could not be found. Jul 14 18:03:51.013251 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:03:51.013251 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:03:51.013251 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:03:51.013251 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:03:51.013251 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:03:51.013251 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:03:51.013251 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:03:51.013251 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:03:51.013251 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:03:51.015785 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:03:51.015785 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 18:03:51.015785 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 18:03:51.015785 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 18:03:51.015785 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 18:03:51.015785 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 18:03:51.015785 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 18:03:51.015785 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 18:03:51.015785 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 18:03:51.015785 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e8e31fc-eea3-4666-90e3-1898f92cf6ba could not be found. Jul 14 18:03:51.015785 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:03:51.015785 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:03:51.015785 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:03:51.015785 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:03:51.015785 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:03:51.015785 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:03:51.015785 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 18:03:51.015785 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 18:03:51.015785 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e8e31fc-eea3-4666-90e3-1898f92cf6ba could not be found. Jul 14 18:03:51.015785 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:03:51.018293 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-43c0e6a1-61af-4e8e-8a94-64115bf15eb8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Returning 404 to user: Instance 1e8e31fc-eea3-4666-90e3-1898f92cf6ba could not be found. {{(pid=129471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:03:51.018293 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-43c0e6a1-61af-4e8e-8a94-64115bf15eb8 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "DELETE /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 404 len: 111 microversion: 2.1 time: 0.031877 Jul 14 18:03:51.018293 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 556/1070] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Jul 14 18:03:50 2022] DELETE /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 18:03:51.020165 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-f6899ba0-6495-4d02-9513-c029fbcc4854 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:03:51.020985 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-f6899ba0-6495-4d02-9513-c029fbcc4854 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] [instance: 1e8e31fc-eea3-4666-90e3-1898f92cf6ba] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:03:51.028422 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f6899ba0-6495-4d02-9513-c029fbcc4854 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:51.028885 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f6899ba0-6495-4d02-9513-c029fbcc4854 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:51.029747 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f6899ba0-6495-4d02-9513-c029fbcc4854 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:03:51.030203 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f6899ba0-6495-4d02-9513-c029fbcc4854 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:03:51.046165 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.wsgi [None req-f6899ba0-6495-4d02-9513-c029fbcc4854 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] HTTP exception thrown: Instance 1e8e31fc-eea3-4666-90e3-1898f92cf6ba could not be found. Jul 14 18:03:51.047865 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-f6899ba0-6495-4d02-9513-c029fbcc4854 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Request method failure captured: Jul 14 18:03:51.047865 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: request: GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba HTTP/1.1 Jul 14 18:03:51.047865 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept: application/json Jul 14 18:03:51.047865 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept-Encoding: identity Jul 14 18:03:51.047865 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Connection: close Jul 14 18:03:51.047865 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Length: 0 Jul 14 18:03:51.047865 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Type: application/json Jul 14 18:03:51.047865 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Host: 10.222.0.64 Jul 14 18:03:51.047865 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Openstack-System-Scope: None Jul 14 18:03:51.047865 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: User-Agent: python-urllib3/1.26.9 Jul 14 18:03:51.047865 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Auth-Token: gAAAAABi0FfHvR6PpIhkosQ1X7_9NpTPXG5F1g5Xt3oqAF0Fb1smJZRvXMYjeWtOXuLV8qjGuJGvzKJ_Q6ZOWEKnG6CONblT1ibngkmWiXLgdhBRRvy0OiDg3hLogpV8lb8YjEQnCidxPy7H0uj1770GzHRBkq97CkOGykDSSpF5meH0d4NIoBA Jul 14 18:03:51.047865 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Id: None Jul 14 18:03:51.047865 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Name: None Jul 14 18:03:51.047865 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Identity-Status: Confirmed Jul 14 18:03:51.047865 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Is-Admin-Project: True Jul 14 18:03:51.047865 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Id: default Jul 14 18:03:51.047865 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Name: Default Jul 14 18:03:51.047865 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Id: e51408d5653d460f82009b65e238281f Jul 14 18:03:51.047865 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Name: tempest-AttachVolumeTestJSON-564883252 Jul 14 18:03:51.047865 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Role: reader,member Jul 14 18:03:51.047865 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Roles: reader,member Jul 14 18:03:51.051074 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e51408d5653d460f82009b65e238281f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e51408d5653d460f82009b65e238281f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e51408d5653d460f82009b65e238281f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e51408d5653d460f82009b65e238281f", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:03:51.051074 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant: tempest-AttachVolumeTestJSON-564883252 Jul 14 18:03:51.051074 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Id: e51408d5653d460f82009b65e238281f Jul 14 18:03:51.051074 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Name: tempest-AttachVolumeTestJSON-564883252 Jul 14 18:03:51.051074 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User: tempest-AttachVolumeTestJSON-564883252-project Jul 14 18:03:51.051074 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Id: default Jul 14 18:03:51.051074 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Name: Default Jul 14 18:03:51.051074 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Id: 84c38f6ff5af4ba79c80fb581baacb0b Jul 14 18:03:51.051074 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Name: tempest-AttachVolumeTestJSON-564883252-project Jul 14 18:03:51.051074 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: method: > Jul 14 18:03:51.051074 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: exception: Instance 1e8e31fc-eea3-4666-90e3-1898f92cf6ba could not be found. Jul 14 18:03:51.051074 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: action_args: {'id': '1e8e31fc-eea3-4666-90e3-1898f92cf6ba'} Jul 14 18:03:51.052462 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:03:51.052462 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:03:51.052462 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 18:03:51.052462 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 18:03:51.052462 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 18:03:51.052462 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 18:03:51.052462 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 18:03:51.052462 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 18:03:51.052462 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 18:03:51.052462 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 18:03:51.052462 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e8e31fc-eea3-4666-90e3-1898f92cf6ba could not be found. Jul 14 18:03:51.052462 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:03:51.052462 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:03:51.052462 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:03:51.052462 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:03:51.052462 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:03:51.052462 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:03:51.052462 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:03:51.052462 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:03:51.052462 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:03:51.054955 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:03:51.054955 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 18:03:51.054955 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 18:03:51.054955 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 18:03:51.054955 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 18:03:51.054955 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 18:03:51.054955 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 18:03:51.054955 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e8e31fc-eea3-4666-90e3-1898f92cf6ba could not be found. Jul 14 18:03:51.054955 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:03:51.054955 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:03:51.054955 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:03:51.054955 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:03:51.054955 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:03:51.054955 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:03:51.054955 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 18:03:51.054955 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 18:03:51.054955 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e8e31fc-eea3-4666-90e3-1898f92cf6ba could not be found. Jul 14 18:03:51.054955 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:03:51.058212 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-f6899ba0-6495-4d02-9513-c029fbcc4854 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] Returning 404 to user: Instance 1e8e31fc-eea3-4666-90e3-1898f92cf6ba could not be found. {{(pid=129470) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:03:51.058212 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-f6899ba0-6495-4d02-9513-c029fbcc4854 tempest-AttachVolumeTestJSON-564883252 tempest-AttachVolumeTestJSON-564883252-project] 10.222.0.64 "GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba" status: 404 len: 111 microversion: 2.1 time: 0.033707 Jul 14 18:03:51.058212 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 515/1071] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:03:51 2022] GET /compute/v2.1/servers/1e8e31fc-eea3-4666-90e3-1898f92cf6ba => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 18:04:00.277144 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-25418fcc-1456-46ae-89f7-5bdedd259798 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Action: 'create', calling method: .version_select at 0x7f137b7ee280>, body: {"keypair": {"name": "tempest-keypair-451777761", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJSNv8Pik/M454XNgUgbHYsp/Axh5/cGjUwiOw2QvbGwlyB2Qqk/LcbQZTxXwa5pgY554yFlqqcL98SqEZxciRm9MrUNfaUEcSEoGUMBK1NGFXHeW0+FnHjPVujhBxbB6g=="}} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:04:00.291320 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.quota [None req-25418fcc-1456-46ae-89f7-5bdedd259798 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Getting quotas for project cd7b0d70fffe4d37a84bd4ee73d044ca. Resources: {'key_pairs'} {{(pid=129471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 18:04:00.295299 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.quota [None req-25418fcc-1456-46ae-89f7-5bdedd259798 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Getting quotas for user d1a7b2376e83489b87feb4b9fd449d55 and project cd7b0d70fffe4d37a84bd4ee73d044ca. Resources: {'key_pairs'} {{(pid=129471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 18:04:00.319699 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-25418fcc-1456-46ae-89f7-5bdedd259798 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.161167 Jul 14 18:04:00.320346 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 557/1072] 10.222.0.64 () {60 vars in 1158 bytes} [Thu Jul 14 18:04:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:04:01.775704 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-aa7ec0a8-fa11-48c3-af28-f6b728d99c15 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1780401271", "imageRef": "cf1f5d8c-9e49-4272-8e19-8e3c587056e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d836dc14-adcd-46d4-983c-5e81fdb4ff39"}], "security_groups": [{"name": "tempest-securitygroup--68039104"}], "key_name": "tempest-keypair-451777761", "user_data": "}} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:04:01.785230 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_api:SELECT=5 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:04:01.785898 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:04:01.917087 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.network.neutron [None req-aa7ec0a8-fa11-48c3-af28-f6b728d99c15 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] validate_networks() for [('d836dc14-adcd-46d4-983c-5e81fdb4ff39', None, None, None, None, None)] {{(pid=129470) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 18:04:02.407907 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-aa7ec0a8-fa11-48c3-af28-f6b728d99c15 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Flavor limits 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 18:04:02.408818 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-aa7ec0a8-fa11-48c3-af28-f6b728d99c15 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Image limits 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 18:04:02.409752 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-aa7ec0a8-fa11-48c3-af28-f6b728d99c15 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Flavor pref 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 18:04:02.410251 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-aa7ec0a8-fa11-48c3-af28-f6b728d99c15 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Image pref 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 18:04:02.410918 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-aa7ec0a8-fa11-48c3-af28-f6b728d99c15 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 18:04:02.422624 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-aa7ec0a8-fa11-48c3-af28-f6b728d99c15 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:02.423166 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-aa7ec0a8-fa11-48c3-af28-f6b728d99c15 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:02.424083 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-aa7ec0a8-fa11-48c3-af28-f6b728d99c15 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:02.424520 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-aa7ec0a8-fa11-48c3-af28-f6b728d99c15 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:02.447433 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.quota [None req-aa7ec0a8-fa11-48c3-af28-f6b728d99c15 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Getting quotas for project cd7b0d70fffe4d37a84bd4ee73d044ca. Resources: {'ram', 'cores', 'instances'} {{(pid=129470) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 18:04:02.452982 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.quota [None req-aa7ec0a8-fa11-48c3-af28-f6b728d99c15 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Getting quotas for user d1a7b2376e83489b87feb4b9fd449d55 and project cd7b0d70fffe4d37a84bd4ee73d044ca. Resources: {'ram', 'cores', 'instances'} {{(pid=129470) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 18:04:02.465042 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-aa7ec0a8-fa11-48c3-af28-f6b728d99c15 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Going to run 1 instances... {{(pid=129470) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 18:04:02.467471 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-aa7ec0a8-fa11-48c3-af28-f6b728d99c15 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 939413a2-1f95-42f5-ad28-5fd1470b709f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf1f5d8c-9e49-4272-8e19-8e3c587056e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129470) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 18:04:02.518895 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-aa7ec0a8-fa11-48c3-af28-f6b728d99c15 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.748885 Jul 14 18:04:02.520275 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 516/1073] 10.222.0.64 () {60 vars in 1146 bytes} [Thu Jul 14 18:04:01 2022] POST /compute/v2.1/servers => generated 400 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 18:04:02.530813 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=54 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:04:02.536742 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-d911aff4-e65b-415c-bdcb-0c432ea2775d tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:04:02.537617 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-d911aff4-e65b-415c-bdcb-0c432ea2775d tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 939413a2-1f95-42f5-ad28-5fd1470b709f] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:04:02.633864 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-d911aff4-e65b-415c-bdcb-0c432ea2775d tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:04:02.647754 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-d911aff4-e65b-415c-bdcb-0c432ea2775d tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f" status: 200 len: 1241 microversion: 2.1 time: 0.117202 Jul 14 18:04:02.649585 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 558/1074] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:04:02 2022] GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f => generated 1241 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:04:03.667126 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-14880a6a-61a7-4819-a196-83b5abf2f640 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:04:03.667972 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-14880a6a-61a7-4819-a196-83b5abf2f640 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 939413a2-1f95-42f5-ad28-5fd1470b709f] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:04:03.677724 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-14880a6a-61a7-4819-a196-83b5abf2f640 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:03.678456 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-14880a6a-61a7-4819-a196-83b5abf2f640 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:03.679258 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-14880a6a-61a7-4819-a196-83b5abf2f640 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:03.680476 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-14880a6a-61a7-4819-a196-83b5abf2f640 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:03.763379 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-14880a6a-61a7-4819-a196-83b5abf2f640 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:04:03.775056 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-14880a6a-61a7-4819-a196-83b5abf2f640 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f" status: 200 len: 1237 microversion: 2.1 time: 0.112187 Jul 14 18:04:03.785430 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 517/1075] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:04:03 2022] GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f => generated 1237 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 18:04:04.792758 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-24171adf-23df-4bf3-a43e-04f30d143e66 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:04:04.793392 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-24171adf-23df-4bf3-a43e-04f30d143e66 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 939413a2-1f95-42f5-ad28-5fd1470b709f] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:04:04.800725 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-24171adf-23df-4bf3-a43e-04f30d143e66 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:04.801180 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-24171adf-23df-4bf3-a43e-04f30d143e66 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:04.801961 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-24171adf-23df-4bf3-a43e-04f30d143e66 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:04.802408 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-24171adf-23df-4bf3-a43e-04f30d143e66 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:04.868344 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-24171adf-23df-4bf3-a43e-04f30d143e66 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:04:04.876744 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-24171adf-23df-4bf3-a43e-04f30d143e66 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f" status: 200 len: 1293 microversion: 2.1 time: 0.087821 Jul 14 18:04:04.877337 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 559/1076] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:04:04 2022] GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:04:05.894094 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-4483fbea-8383-4efb-8666-6bd18fc081c3 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:04:05.894710 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-4483fbea-8383-4efb-8666-6bd18fc081c3 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 939413a2-1f95-42f5-ad28-5fd1470b709f] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:04:05.901344 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4483fbea-8383-4efb-8666-6bd18fc081c3 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:05.901802 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4483fbea-8383-4efb-8666-6bd18fc081c3 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:05.902585 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4483fbea-8383-4efb-8666-6bd18fc081c3 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:05.903030 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4483fbea-8383-4efb-8666-6bd18fc081c3 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:05.971230 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-4483fbea-8383-4efb-8666-6bd18fc081c3 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:04:05.978791 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-4483fbea-8383-4efb-8666-6bd18fc081c3 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f" status: 200 len: 1293 microversion: 2.1 time: 0.089030 Jul 14 18:04:05.979374 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 518/1077] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:04:05 2022] GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f => generated 1293 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:04:06.996368 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-79145903-8489-4d8d-b485-e6366c6fff6f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:04:06.996987 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-79145903-8489-4d8d-b485-e6366c6fff6f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 939413a2-1f95-42f5-ad28-5fd1470b709f] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:04:07.004402 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-79145903-8489-4d8d-b485-e6366c6fff6f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:07.004858 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-79145903-8489-4d8d-b485-e6366c6fff6f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:07.005638 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-79145903-8489-4d8d-b485-e6366c6fff6f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:07.006078 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-79145903-8489-4d8d-b485-e6366c6fff6f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:07.068211 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-79145903-8489-4d8d-b485-e6366c6fff6f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:04:07.076108 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-79145903-8489-4d8d-b485-e6366c6fff6f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f" status: 200 len: 1293 microversion: 2.1 time: 0.083530 Jul 14 18:04:07.076694 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 560/1078] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:04:06 2022] GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:04:08.093552 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-d78af3c6-396d-4793-8f02-fb84a5d52180 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:04:08.094148 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-d78af3c6-396d-4793-8f02-fb84a5d52180 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 939413a2-1f95-42f5-ad28-5fd1470b709f] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:04:08.101277 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d78af3c6-396d-4793-8f02-fb84a5d52180 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:08.101724 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d78af3c6-396d-4793-8f02-fb84a5d52180 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:08.102538 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d78af3c6-396d-4793-8f02-fb84a5d52180 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:08.103006 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d78af3c6-396d-4793-8f02-fb84a5d52180 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:08.170486 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-d78af3c6-396d-4793-8f02-fb84a5d52180 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:04:08.180047 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-d78af3c6-396d-4793-8f02-fb84a5d52180 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f" status: 200 len: 1299 microversion: 2.1 time: 0.090688 Jul 14 18:04:08.182068 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 519/1079] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:04:08 2022] GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f => generated 1299 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:04:09.197479 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-6c6392d4-2ed0-412b-a24a-b3035f56b866 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:04:09.199612 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-6c6392d4-2ed0-412b-a24a-b3035f56b866 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 939413a2-1f95-42f5-ad28-5fd1470b709f] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:04:09.207903 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6c6392d4-2ed0-412b-a24a-b3035f56b866 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:09.208405 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6c6392d4-2ed0-412b-a24a-b3035f56b866 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:09.209325 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6c6392d4-2ed0-412b-a24a-b3035f56b866 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:09.210056 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6c6392d4-2ed0-412b-a24a-b3035f56b866 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:09.367510 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-6c6392d4-2ed0-412b-a24a-b3035f56b866 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:04:09.377833 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-6c6392d4-2ed0-412b-a24a-b3035f56b866 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f" status: 200 len: 1365 microversion: 2.1 time: 0.184116 Jul 14 18:04:09.378777 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 561/1080] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:04:09 2022] GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:04:09.480442 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-5f94b177-5f9b-4ee7-bb6a-0bc668d32e17 req-0af9b6d9-d145-45b3-bf4a-68bd1b72de8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "939413a2-1f95-42f5-ad28-5fd1470b709f", "tag": "db745698-bdb6-48c6-af8f-bc37b9606371"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:04:09.490702 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-5f94b177-5f9b-4ee7-bb6a-0bc668d32e17 req-0af9b6d9-d145-45b3-bf4a-68bd1b72de8f service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:09.491246 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-5f94b177-5f9b-4ee7-bb6a-0bc668d32e17 req-0af9b6d9-d145-45b3-bf4a-68bd1b72de8f service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:09.504783 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-5f94b177-5f9b-4ee7-bb6a-0bc668d32e17 req-0af9b6d9-d145-45b3-bf4a-68bd1b72de8f service nova] Creating event network-changed:db745698-bdb6-48c6-af8f-bc37b9606371 for instance 939413a2-1f95-42f5-ad28-5fd1470b709f on hv-cinder-84989 Jul 14 18:04:09.510098 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-5f94b177-5f9b-4ee7-bb6a-0bc668d32e17 req-0af9b6d9-d145-45b3-bf4a-68bd1b72de8f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033254 Jul 14 18:04:09.511335 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 520/1081] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:04:10.403059 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-a4dca14d-570a-493a-9665-4f09d11e195e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:04:10.403691 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-a4dca14d-570a-493a-9665-4f09d11e195e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 939413a2-1f95-42f5-ad28-5fd1470b709f] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:04:10.411333 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a4dca14d-570a-493a-9665-4f09d11e195e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:10.411788 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a4dca14d-570a-493a-9665-4f09d11e195e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:10.412615 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a4dca14d-570a-493a-9665-4f09d11e195e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:10.413053 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a4dca14d-570a-493a-9665-4f09d11e195e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:10.545636 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-a4dca14d-570a-493a-9665-4f09d11e195e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:04:10.553295 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-a4dca14d-570a-493a-9665-4f09d11e195e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f" status: 200 len: 1365 microversion: 2.1 time: 0.154321 Jul 14 18:04:10.553875 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 562/1082] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:04:10 2022] GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:04:11.571243 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-3b9463d6-edfe-4876-8e77-826c434b405f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:04:11.571847 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-3b9463d6-edfe-4876-8e77-826c434b405f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 939413a2-1f95-42f5-ad28-5fd1470b709f] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:04:11.578058 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3b9463d6-edfe-4876-8e77-826c434b405f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:11.578500 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3b9463d6-edfe-4876-8e77-826c434b405f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:11.579254 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3b9463d6-edfe-4876-8e77-826c434b405f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:11.579688 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3b9463d6-edfe-4876-8e77-826c434b405f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:11.710354 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-3b9463d6-edfe-4876-8e77-826c434b405f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:04:11.717929 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-3b9463d6-edfe-4876-8e77-826c434b405f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f" status: 200 len: 1365 microversion: 2.1 time: 0.151442 Jul 14 18:04:11.718504 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 521/1083] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:04:11 2022] GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:04:12.735254 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-28b3d035-0b53-4d09-9fd0-3d2589e00aed tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:04:12.735781 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-28b3d035-0b53-4d09-9fd0-3d2589e00aed tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 939413a2-1f95-42f5-ad28-5fd1470b709f] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:04:12.738085 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell0:SELECT=6 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:04:12.743535 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-28b3d035-0b53-4d09-9fd0-3d2589e00aed tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:12.744009 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-28b3d035-0b53-4d09-9fd0-3d2589e00aed tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:12.744772 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-28b3d035-0b53-4d09-9fd0-3d2589e00aed tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:12.745204 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-28b3d035-0b53-4d09-9fd0-3d2589e00aed tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:12.875954 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-28b3d035-0b53-4d09-9fd0-3d2589e00aed tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:04:12.883379 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-28b3d035-0b53-4d09-9fd0-3d2589e00aed tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f" status: 200 len: 1365 microversion: 2.1 time: 0.152634 Jul 14 18:04:12.883963 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 563/1084] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:04:12 2022] GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:04:13.224989 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-df5e12e1-2a62-44f2-a4ab-07ab34cd5250 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:04:13.225496 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-df5e12e1-2a62-44f2-a4ab-07ab34cd5250 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: b365d72e-49c5-4ad5-a92a-0e2de1580bbf] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:04:13.227411 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell0:SELECT=2 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:04:13.228315 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell0:SELECT=6 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:04:13.234936 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-df5e12e1-2a62-44f2-a4ab-07ab34cd5250 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:13.235378 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-df5e12e1-2a62-44f2-a4ab-07ab34cd5250 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:13.236170 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-df5e12e1-2a62-44f2-a4ab-07ab34cd5250 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:13.236603 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-df5e12e1-2a62-44f2-a4ab-07ab34cd5250 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:13.315757 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.objects.instance [None req-df5e12e1-2a62-44f2-a4ab-07ab34cd5250 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lazy-loading 'services' on Instance uuid b365d72e-49c5-4ad5-a92a-0e2de1580bbf {{(pid=129470) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 18:04:13.389345 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-df5e12e1-2a62-44f2-a4ab-07ab34cd5250 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "DELETE /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf/os-volume_attachments/46acb19a-50f5-488e-907d-10236309e4e7" status: 202 len: 0 microversion: 2.1 time: 0.168033 Jul 14 18:04:13.389938 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 522/1085] 10.222.0.64 () {58 vars in 1415 bytes} [Thu Jul 14 18:04:13 2022] DELETE /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf/os-volume_attachments/46acb19a-50f5-488e-907d-10236309e4e7 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 18:04:13.900584 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-c6ecb42d-4741-46da-bee7-104fac9c3556 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:04:13.901130 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-c6ecb42d-4741-46da-bee7-104fac9c3556 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 939413a2-1f95-42f5-ad28-5fd1470b709f] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:04:13.907503 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c6ecb42d-4741-46da-bee7-104fac9c3556 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:13.907977 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c6ecb42d-4741-46da-bee7-104fac9c3556 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:13.908732 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c6ecb42d-4741-46da-bee7-104fac9c3556 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:13.909162 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c6ecb42d-4741-46da-bee7-104fac9c3556 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:14.039873 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-c6ecb42d-4741-46da-bee7-104fac9c3556 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:04:14.047405 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-c6ecb42d-4741-46da-bee7-104fac9c3556 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f" status: 200 len: 1365 microversion: 2.1 time: 0.150798 Jul 14 18:04:14.048003 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 564/1086] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:04:13 2022] GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:04:14.509982 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-6accd65b-c4ca-4919-bc0c-2d8695851039 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:04:14.510836 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-6accd65b-c4ca-4919-bc0c-2d8695851039 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: b365d72e-49c5-4ad5-a92a-0e2de1580bbf] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:04:14.517914 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6accd65b-c4ca-4919-bc0c-2d8695851039 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:14.518380 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6accd65b-c4ca-4919-bc0c-2d8695851039 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:14.519149 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6accd65b-c4ca-4919-bc0c-2d8695851039 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:14.519609 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6accd65b-c4ca-4919-bc0c-2d8695851039 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:14.545082 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-6accd65b-c4ca-4919-bc0c-2d8695851039 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: b365d72e-49c5-4ad5-a92a-0e2de1580bbf] Going to try to terminate instance {{(pid=129470) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 18:04:14.624946 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-6accd65b-c4ca-4919-bc0c-2d8695851039 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "DELETE /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf" status: 204 len: 0 microversion: 2.1 time: 0.118890 Jul 14 18:04:14.625548 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 523/1087] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Jul 14 18:04:14 2022] DELETE /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 18:04:14.634003 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-436cad76-ea79-43d0-a48c-830c43c8a9e3 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:04:14.634628 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-436cad76-ea79-43d0-a48c-830c43c8a9e3 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: b365d72e-49c5-4ad5-a92a-0e2de1580bbf] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:04:14.640981 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-436cad76-ea79-43d0-a48c-830c43c8a9e3 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:14.641434 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-436cad76-ea79-43d0-a48c-830c43c8a9e3 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:14.642219 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-436cad76-ea79-43d0-a48c-830c43c8a9e3 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:14.642665 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-436cad76-ea79-43d0-a48c-830c43c8a9e3 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:14.789001 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-436cad76-ea79-43d0-a48c-830c43c8a9e3 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dd1356e5bc4d35aca1bf1edf6f2140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ce085523d84754b8d107b5c0936491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:04:14.799220 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-436cad76-ea79-43d0-a48c-830c43c8a9e3 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "GET /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf" status: 200 len: 1513 microversion: 2.1 time: 0.168994 Jul 14 18:04:14.799816 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 565/1088] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:04:14 2022] GET /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:04:15.065360 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-60d208ef-a351-4470-9272-9ff495276772 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:04:15.066069 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-60d208ef-a351-4470-9272-9ff495276772 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 939413a2-1f95-42f5-ad28-5fd1470b709f] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:04:15.072287 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-60d208ef-a351-4470-9272-9ff495276772 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:15.072742 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-60d208ef-a351-4470-9272-9ff495276772 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:15.073512 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-60d208ef-a351-4470-9272-9ff495276772 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:15.073953 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-60d208ef-a351-4470-9272-9ff495276772 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:15.208764 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-60d208ef-a351-4470-9272-9ff495276772 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:04:15.216811 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-60d208ef-a351-4470-9272-9ff495276772 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f" status: 200 len: 1365 microversion: 2.1 time: 0.155757 Jul 14 18:04:15.217743 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 524/1089] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:04:15 2022] GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:04:15.816524 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-555d9e0a-a1f6-471e-9c22-59ded67e3d46 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:04:15.817145 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-555d9e0a-a1f6-471e-9c22-59ded67e3d46 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: b365d72e-49c5-4ad5-a92a-0e2de1580bbf] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:04:15.823628 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-555d9e0a-a1f6-471e-9c22-59ded67e3d46 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:15.824121 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-555d9e0a-a1f6-471e-9c22-59ded67e3d46 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:15.824893 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-555d9e0a-a1f6-471e-9c22-59ded67e3d46 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:15.825339 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-555d9e0a-a1f6-471e-9c22-59ded67e3d46 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:15.956356 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-555d9e0a-a1f6-471e-9c22-59ded67e3d46 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dd1356e5bc4d35aca1bf1edf6f2140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ce085523d84754b8d107b5c0936491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:04:15.964157 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-555d9e0a-a1f6-471e-9c22-59ded67e3d46 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "GET /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf" status: 200 len: 1513 microversion: 2.1 time: 0.151464 Jul 14 18:04:15.964723 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 566/1090] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:04:15 2022] GET /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:04:16.234562 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-b8ca059f-b637-4e04-b0e8-793451ddf3d4 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:04:16.235181 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-b8ca059f-b637-4e04-b0e8-793451ddf3d4 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 939413a2-1f95-42f5-ad28-5fd1470b709f] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:04:16.241734 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b8ca059f-b637-4e04-b0e8-793451ddf3d4 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:16.242189 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b8ca059f-b637-4e04-b0e8-793451ddf3d4 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:16.242963 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b8ca059f-b637-4e04-b0e8-793451ddf3d4 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:16.243408 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b8ca059f-b637-4e04-b0e8-793451ddf3d4 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:16.370956 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-b8ca059f-b637-4e04-b0e8-793451ddf3d4 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:04:16.378804 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-b8ca059f-b637-4e04-b0e8-793451ddf3d4 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f" status: 200 len: 1365 microversion: 2.1 time: 0.148695 Jul 14 18:04:16.379334 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 525/1091] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:04:16 2022] GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:04:16.601102 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [req-2f56a054-f208-4c12-bd64-f7de64c46019 req-cca6451a-6f5a-4305-ba25-1742432100cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "939413a2-1f95-42f5-ad28-5fd1470b709f", "name": "network-vif-plugged", "status": "completed", "tag": "db745698-bdb6-48c6-af8f-bc37b9606371"}]} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:04:16.609357 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-2f56a054-f208-4c12-bd64-f7de64c46019 req-cca6451a-6f5a-4305-ba25-1742432100cb service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:16.609847 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-2f56a054-f208-4c12-bd64-f7de64c46019 req-cca6451a-6f5a-4305-ba25-1742432100cb service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:16.621088 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.compute.server_external_events [req-2f56a054-f208-4c12-bd64-f7de64c46019 req-cca6451a-6f5a-4305-ba25-1742432100cb service nova] Creating event network-vif-plugged:db745698-bdb6-48c6-af8f-bc37b9606371 for instance 939413a2-1f95-42f5-ad28-5fd1470b709f on hv-cinder-84989 Jul 14 18:04:16.626064 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [req-2f56a054-f208-4c12-bd64-f7de64c46019 req-cca6451a-6f5a-4305-ba25-1742432100cb service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028745 Jul 14 18:04:16.626658 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 567/1092] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:04:16.981777 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-f8dafa1d-c35f-4cd5-b91b-469c4705e7df tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:04:16.982511 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-f8dafa1d-c35f-4cd5-b91b-469c4705e7df tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: b365d72e-49c5-4ad5-a92a-0e2de1580bbf] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:04:16.988710 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f8dafa1d-c35f-4cd5-b91b-469c4705e7df tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:16.989167 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f8dafa1d-c35f-4cd5-b91b-469c4705e7df tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:16.989951 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f8dafa1d-c35f-4cd5-b91b-469c4705e7df tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:16.990397 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f8dafa1d-c35f-4cd5-b91b-469c4705e7df tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:17.134509 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-f8dafa1d-c35f-4cd5-b91b-469c4705e7df tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dd1356e5bc4d35aca1bf1edf6f2140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ce085523d84754b8d107b5c0936491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:04:17.142492 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-f8dafa1d-c35f-4cd5-b91b-469c4705e7df tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "GET /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf" status: 200 len: 1513 microversion: 2.1 time: 0.164502 Jul 14 18:04:17.143079 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 526/1093] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:04:16 2022] GET /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:04:17.397653 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-4750852c-b812-4cc8-8cf2-19e0977a4cfd tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:04:17.398377 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-4750852c-b812-4cc8-8cf2-19e0977a4cfd tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 939413a2-1f95-42f5-ad28-5fd1470b709f] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:04:17.400681 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:04:17.414930 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4750852c-b812-4cc8-8cf2-19e0977a4cfd tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:17.415733 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4750852c-b812-4cc8-8cf2-19e0977a4cfd tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:17.417220 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4750852c-b812-4cc8-8cf2-19e0977a4cfd tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:17.417997 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4750852c-b812-4cc8-8cf2-19e0977a4cfd tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:17.593481 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-4750852c-b812-4cc8-8cf2-19e0977a4cfd tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:04:17.601181 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-4750852c-b812-4cc8-8cf2-19e0977a4cfd tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f" status: 200 len: 1365 microversion: 2.1 time: 0.208325 Jul 14 18:04:17.601858 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 568/1094] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:04:17 2022] GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f => generated 1365 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:04:17.846268 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-08943586-d253-4383-9835-1681f9bf4b38 req-280850de-70ec-4684-b8f0-90c0d80557c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b365d72e-49c5-4ad5-a92a-0e2de1580bbf", "name": "network-vif-deleted", "tag": "06d59003-e8af-4084-9c62-e9bd38fe4c28"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:04:17.856286 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-08943586-d253-4383-9835-1681f9bf4b38 req-280850de-70ec-4684-b8f0-90c0d80557c5 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:17.856763 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-08943586-d253-4383-9835-1681f9bf4b38 req-280850de-70ec-4684-b8f0-90c0d80557c5 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:17.872688 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-08943586-d253-4383-9835-1681f9bf4b38 req-280850de-70ec-4684-b8f0-90c0d80557c5 service nova] Creating event network-vif-deleted:06d59003-e8af-4084-9c62-e9bd38fe4c28 for instance b365d72e-49c5-4ad5-a92a-0e2de1580bbf on hv-cinder-84989 Jul 14 18:04:17.877930 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-08943586-d253-4383-9835-1681f9bf4b38 req-280850de-70ec-4684-b8f0-90c0d80557c5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035841 Jul 14 18:04:17.878819 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 527/1095] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:04:18.160414 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-7d3e6eb6-466c-45fe-8ad2-4f5c9b5e94d1 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:04:18.161031 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-7d3e6eb6-466c-45fe-8ad2-4f5c9b5e94d1 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: b365d72e-49c5-4ad5-a92a-0e2de1580bbf] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:04:18.167023 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7d3e6eb6-466c-45fe-8ad2-4f5c9b5e94d1 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:18.167440 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7d3e6eb6-466c-45fe-8ad2-4f5c9b5e94d1 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:18.168302 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7d3e6eb6-466c-45fe-8ad2-4f5c9b5e94d1 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:18.168738 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7d3e6eb6-466c-45fe-8ad2-4f5c9b5e94d1 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:18.198519 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7d3e6eb6-466c-45fe-8ad2-4f5c9b5e94d1 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:18.198963 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7d3e6eb6-466c-45fe-8ad2-4f5c9b5e94d1 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:18.199408 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.objects.instance [None req-7d3e6eb6-466c-45fe-8ad2-4f5c9b5e94d1 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lazy-loading 'fault' on Instance uuid b365d72e-49c5-4ad5-a92a-0e2de1580bbf {{(pid=129471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 18:04:18.240058 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-7d3e6eb6-466c-45fe-8ad2-4f5c9b5e94d1 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dd1356e5bc4d35aca1bf1edf6f2140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ce085523d84754b8d107b5c0936491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:04:18.247695 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-7d3e6eb6-466c-45fe-8ad2-4f5c9b5e94d1 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "GET /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf" status: 200 len: 1308 microversion: 2.1 time: 0.091211 Jul 14 18:04:18.248299 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 569/1096] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:04:18 2022] GET /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf => generated 1308 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 18:04:18.619586 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-cf6e49b9-587c-4738-ba58-cd1eca0188e1 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:04:18.620307 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-cf6e49b9-587c-4738-ba58-cd1eca0188e1 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 939413a2-1f95-42f5-ad28-5fd1470b709f] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:04:18.627260 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-cf6e49b9-587c-4738-ba58-cd1eca0188e1 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:18.627837 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-cf6e49b9-587c-4738-ba58-cd1eca0188e1 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:18.629510 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-cf6e49b9-587c-4738-ba58-cd1eca0188e1 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:18.629638 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-cf6e49b9-587c-4738-ba58-cd1eca0188e1 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:18.765610 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-cf6e49b9-587c-4738-ba58-cd1eca0188e1 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:04:18.773533 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-cf6e49b9-587c-4738-ba58-cd1eca0188e1 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f" status: 200 len: 1554 microversion: 2.1 time: 0.158309 Jul 14 18:04:18.774100 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 528/1097] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:04:18 2022] GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:04:18.790066 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-5c623c48-4b16-4020-bc4f-78bf7c778d70 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:04:18.790561 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-5c623c48-4b16-4020-bc4f-78bf7c778d70 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 939413a2-1f95-42f5-ad28-5fd1470b709f] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:04:18.797591 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5c623c48-4b16-4020-bc4f-78bf7c778d70 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:18.798037 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5c623c48-4b16-4020-bc4f-78bf7c778d70 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:18.798797 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5c623c48-4b16-4020-bc4f-78bf7c778d70 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:18.799252 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5c623c48-4b16-4020-bc4f-78bf7c778d70 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:18.880685 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-5c623c48-4b16-4020-bc4f-78bf7c778d70 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094542 Jul 14 18:04:18.881512 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 570/1098] 10.222.0.64 () {58 vars in 1274 bytes} [Thu Jul 14 18:04:18 2022] GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:04:19.264710 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-cee0cee1-8cc5-45ed-9604-b11710d06eb4 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:04:19.265318 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-cee0cee1-8cc5-45ed-9604-b11710d06eb4 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] [instance: b365d72e-49c5-4ad5-a92a-0e2de1580bbf] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:04:19.272218 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-cee0cee1-8cc5-45ed-9604-b11710d06eb4 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:19.272679 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-cee0cee1-8cc5-45ed-9604-b11710d06eb4 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:19.273468 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-cee0cee1-8cc5-45ed-9604-b11710d06eb4 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:19.273908 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-cee0cee1-8cc5-45ed-9604-b11710d06eb4 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:19.288964 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.wsgi [None req-cee0cee1-8cc5-45ed-9604-b11710d06eb4 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] HTTP exception thrown: Instance b365d72e-49c5-4ad5-a92a-0e2de1580bbf could not be found. Jul 14 18:04:19.290674 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-cee0cee1-8cc5-45ed-9604-b11710d06eb4 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Request method failure captured: Jul 14 18:04:19.290674 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: request: GET /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf HTTP/1.1 Jul 14 18:04:19.290674 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept: application/json Jul 14 18:04:19.290674 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept-Encoding: identity Jul 14 18:04:19.290674 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Connection: close Jul 14 18:04:19.290674 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Length: 0 Jul 14 18:04:19.290674 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Type: application/json Jul 14 18:04:19.290674 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Host: 10.222.0.64 Jul 14 18:04:19.290674 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Openstack-System-Scope: None Jul 14 18:04:19.290674 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: User-Agent: python-urllib3/1.26.9 Jul 14 18:04:19.290674 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Auth-Token: gAAAAABi0FoatFPS1l048NvrH728aj6tL2yzEX1Yy8KG7WwqWCTnRLgG6dYORmdiSrx-auSbfYtpTo6iptXDZr6XpeS1saowOiCwrmiQ0V7A0CGBsuniEwq0e6cCDlgwZEdBJ5i0fNBvRmcJUfCrs4FUV7L9J7xtvRJe34h568oViCbqIfKb9X8 Jul 14 18:04:19.290674 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Id: None Jul 14 18:04:19.290674 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Name: None Jul 14 18:04:19.290674 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Identity-Status: Confirmed Jul 14 18:04:19.290674 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Is-Admin-Project: True Jul 14 18:04:19.290674 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Id: default Jul 14 18:04:19.290674 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Name: Default Jul 14 18:04:19.290674 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Id: 73ce085523d84754b8d107b5c0936491 Jul 14 18:04:19.290674 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2108847370 Jul 14 18:04:19.290674 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Role: reader,member Jul 14 18:04:19.290674 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Roles: reader,member Jul 14 18:04:19.292307 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/73ce085523d84754b8d107b5c0936491"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/73ce085523d84754b8d107b5c0936491"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/73ce085523d84754b8d107b5c0936491"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_73ce085523d84754b8d107b5c0936491", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:04:19.292307 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant: tempest-VolumesSnapshotTestJSON-2108847370 Jul 14 18:04:19.292307 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Id: 73ce085523d84754b8d107b5c0936491 Jul 14 18:04:19.292307 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2108847370 Jul 14 18:04:19.292307 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User: tempest-VolumesSnapshotTestJSON-2108847370-project Jul 14 18:04:19.292307 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Id: default Jul 14 18:04:19.292307 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Name: Default Jul 14 18:04:19.292307 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Id: d8dd1356e5bc4d35aca1bf1edf6f2140 Jul 14 18:04:19.292307 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Name: tempest-VolumesSnapshotTestJSON-2108847370-project Jul 14 18:04:19.292307 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: method: > Jul 14 18:04:19.292307 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: exception: Instance b365d72e-49c5-4ad5-a92a-0e2de1580bbf could not be found. Jul 14 18:04:19.292307 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: action_args: {'id': 'b365d72e-49c5-4ad5-a92a-0e2de1580bbf'} Jul 14 18:04:19.293114 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:04:19.293114 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:04:19.293114 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 18:04:19.293114 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 18:04:19.293114 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 18:04:19.293114 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 18:04:19.293114 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 18:04:19.293114 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 18:04:19.293114 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 18:04:19.293114 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 18:04:19.293114 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b365d72e-49c5-4ad5-a92a-0e2de1580bbf could not be found. Jul 14 18:04:19.293114 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:04:19.293114 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:04:19.293114 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:04:19.293114 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:04:19.293114 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:04:19.293114 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:04:19.293114 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:04:19.293114 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:04:19.293114 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:04:19.294695 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:04:19.294695 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 18:04:19.294695 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 18:04:19.294695 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 18:04:19.294695 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 18:04:19.294695 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 18:04:19.294695 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 18:04:19.294695 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b365d72e-49c5-4ad5-a92a-0e2de1580bbf could not be found. Jul 14 18:04:19.294695 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:04:19.294695 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:04:19.294695 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:04:19.294695 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:04:19.294695 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:04:19.294695 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:04:19.294695 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 18:04:19.294695 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 18:04:19.294695 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b365d72e-49c5-4ad5-a92a-0e2de1580bbf could not be found. Jul 14 18:04:19.294695 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:04:19.297805 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-cee0cee1-8cc5-45ed-9604-b11710d06eb4 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] Returning 404 to user: Instance b365d72e-49c5-4ad5-a92a-0e2de1580bbf could not be found. {{(pid=129470) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:04:19.297805 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-cee0cee1-8cc5-45ed-9604-b11710d06eb4 tempest-VolumesSnapshotTestJSON-2108847370 tempest-VolumesSnapshotTestJSON-2108847370-project] 10.222.0.64 "GET /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf" status: 404 len: 111 microversion: 2.1 time: 0.031386 Jul 14 18:04:19.297805 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 529/1099] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:04:19 2022] GET /compute/v2.1/servers/b365d72e-49c5-4ad5-a92a-0e2de1580bbf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 18:04:20.102937 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [req-523dfcd0-c35f-44da-aebe-8e48fb40b516 req-19456bea-5201-4e27-833a-b5395b1c8f21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "939413a2-1f95-42f5-ad28-5fd1470b709f", "tag": "db745698-bdb6-48c6-af8f-bc37b9606371"}]} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:04:20.111498 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-523dfcd0-c35f-44da-aebe-8e48fb40b516 req-19456bea-5201-4e27-833a-b5395b1c8f21 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:20.111970 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-523dfcd0-c35f-44da-aebe-8e48fb40b516 req-19456bea-5201-4e27-833a-b5395b1c8f21 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:20.124044 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.compute.server_external_events [req-523dfcd0-c35f-44da-aebe-8e48fb40b516 req-19456bea-5201-4e27-833a-b5395b1c8f21 service nova] Creating event network-changed:db745698-bdb6-48c6-af8f-bc37b9606371 for instance 939413a2-1f95-42f5-ad28-5fd1470b709f on hv-cinder-84989 Jul 14 18:04:20.129091 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [req-523dfcd0-c35f-44da-aebe-8e48fb40b516 req-19456bea-5201-4e27-833a-b5395b1c8f21 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030324 Jul 14 18:04:20.129701 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 571/1100] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:04:36.886285 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-ba57fa6b-6d2b-4f46-8cbd-21080476775f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:04:36.887206 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-ba57fa6b-6d2b-4f46-8cbd-21080476775f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:04:36.889544 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:04:36.890196 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:04:36.897504 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ba57fa6b-6d2b-4f46-8cbd-21080476775f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:36.897950 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ba57fa6b-6d2b-4f46-8cbd-21080476775f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:36.898735 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ba57fa6b-6d2b-4f46-8cbd-21080476775f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:36.899178 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ba57fa6b-6d2b-4f46-8cbd-21080476775f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:36.938284 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-ba57fa6b-6d2b-4f46-8cbd-21080476775f tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.056131 Jul 14 18:04:36.938977 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 530/1101] 10.222.0.64 () {60 vars in 1342 bytes} [Thu Jul 14 18:04:36 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:04:36.999302 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_api:SELECT=9 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:04:37.000432 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=70 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:04:37.005200 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-d9f4e271-b500-4d53-a00a-3f30dbabf930 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:04:37.005799 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-d9f4e271-b500-4d53-a00a-3f30dbabf930 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:04:37.013247 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d9f4e271-b500-4d53-a00a-3f30dbabf930 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:37.013700 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d9f4e271-b500-4d53-a00a-3f30dbabf930 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:37.014546 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d9f4e271-b500-4d53-a00a-3f30dbabf930 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:37.014989 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d9f4e271-b500-4d53-a00a-3f30dbabf930 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:37.043275 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-d9f4e271-b500-4d53-a00a-3f30dbabf930 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Going to try to terminate instance {{(pid=129471) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 18:04:37.129838 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-d9f4e271-b500-4d53-a00a-3f30dbabf930 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "DELETE /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 204 len: 0 microversion: 2.20 time: 0.132029 Jul 14 18:04:37.130669 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 572/1102] 10.222.0.64 () {60 vars in 1279 bytes} [Thu Jul 14 18:04:36 2022] DELETE /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 18:04:37.139207 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-12897198-d3c9-4775-a237-1ca51bb060f0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:04:37.139819 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-12897198-d3c9-4775-a237-1ca51bb060f0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:04:37.146043 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-12897198-d3c9-4775-a237-1ca51bb060f0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:37.146498 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-12897198-d3c9-4775-a237-1ca51bb060f0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:37.147277 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-12897198-d3c9-4775-a237-1ca51bb060f0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:37.147720 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-12897198-d3c9-4775-a237-1ca51bb060f0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:37.280039 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-12897198-d3c9-4775-a237-1ca51bb060f0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:04:37.288394 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-12897198-d3c9-4775-a237-1ca51bb060f0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:04:37.289921 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-12897198-d3c9-4775-a237-1ca51bb060f0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:04:37.292699 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-12897198-d3c9-4775-a237-1ca51bb060f0 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1726 microversion: 2.20 time: 0.155912 Jul 14 18:04:37.292699 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 531/1103] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:04:37 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:04:38.312109 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-6e345f24-e81a-44a7-9ae1-60904e388b3c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:04:38.312799 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-6e345f24-e81a-44a7-9ae1-60904e388b3c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:04:38.319407 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6e345f24-e81a-44a7-9ae1-60904e388b3c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:38.319853 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6e345f24-e81a-44a7-9ae1-60904e388b3c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:38.320654 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6e345f24-e81a-44a7-9ae1-60904e388b3c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:38.321086 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6e345f24-e81a-44a7-9ae1-60904e388b3c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:38.462461 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-6e345f24-e81a-44a7-9ae1-60904e388b3c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:04:38.470933 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-6e345f24-e81a-44a7-9ae1-60904e388b3c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:04:38.472454 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-6e345f24-e81a-44a7-9ae1-60904e388b3c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:04:38.473611 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-6e345f24-e81a-44a7-9ae1-60904e388b3c tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1726 microversion: 2.20 time: 0.165860 Jul 14 18:04:38.474162 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 573/1104] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:04:38 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:04:39.493266 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-d939a4cf-fe2c-451a-98f8-da6115c17cea tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:04:39.494876 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-d939a4cf-fe2c-451a-98f8-da6115c17cea tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:04:39.502709 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d939a4cf-fe2c-451a-98f8-da6115c17cea tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:39.503173 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d939a4cf-fe2c-451a-98f8-da6115c17cea tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:39.503994 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d939a4cf-fe2c-451a-98f8-da6115c17cea tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:39.504442 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d939a4cf-fe2c-451a-98f8-da6115c17cea tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:39.636107 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-d939a4cf-fe2c-451a-98f8-da6115c17cea tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:04:39.644347 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-d939a4cf-fe2c-451a-98f8-da6115c17cea tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:04:39.645875 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-d939a4cf-fe2c-451a-98f8-da6115c17cea tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:04:39.647049 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-d939a4cf-fe2c-451a-98f8-da6115c17cea tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1726 microversion: 2.20 time: 0.158391 Jul 14 18:04:39.647616 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 532/1105] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:04:39 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:04:40.334549 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [req-6ca0fad5-b1d5-4145-9278-4231f8a59b87 req-d20a495c-d49d-4fca-a8e8-faaf773ef28c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "509b127f-76cb-4358-84a9-457d4e0397ec", "name": "network-vif-deleted", "tag": "ab754da5-453e-411a-a26f-b36d77ef6e13"}]} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:04:40.356859 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-6ca0fad5-b1d5-4145-9278-4231f8a59b87 req-d20a495c-d49d-4fca-a8e8-faaf773ef28c service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:40.358155 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-6ca0fad5-b1d5-4145-9278-4231f8a59b87 req-d20a495c-d49d-4fca-a8e8-faaf773ef28c service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:40.381888 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.compute.server_external_events [req-6ca0fad5-b1d5-4145-9278-4231f8a59b87 req-d20a495c-d49d-4fca-a8e8-faaf773ef28c service nova] Creating event network-vif-deleted:ab754da5-453e-411a-a26f-b36d77ef6e13 for instance 509b127f-76cb-4358-84a9-457d4e0397ec on hv-cinder-84989 Jul 14 18:04:40.390476 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [req-6ca0fad5-b1d5-4145-9278-4231f8a59b87 req-d20a495c-d49d-4fca-a8e8-faaf773ef28c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172664 Jul 14 18:04:40.391442 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 574/1106] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:04:40.666856 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-09039f5f-f9e1-4d22-9dc9-239d5191de6d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:04:40.667786 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-09039f5f-f9e1-4d22-9dc9-239d5191de6d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:04:40.675451 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-09039f5f-f9e1-4d22-9dc9-239d5191de6d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:40.675902 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-09039f5f-f9e1-4d22-9dc9-239d5191de6d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:40.676759 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-09039f5f-f9e1-4d22-9dc9-239d5191de6d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:40.677195 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-09039f5f-f9e1-4d22-9dc9-239d5191de6d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:40.718711 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-09039f5f-f9e1-4d22-9dc9-239d5191de6d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:40.724145 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-09039f5f-f9e1-4d22-9dc9-239d5191de6d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:40.724145 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.objects.instance [None req-09039f5f-f9e1-4d22-9dc9-239d5191de6d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lazy-loading 'fault' on Instance uuid 509b127f-76cb-4358-84a9-457d4e0397ec {{(pid=129470) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 18:04:40.780318 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-09039f5f-f9e1-4d22-9dc9-239d5191de6d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:04:40.796693 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-09039f5f-f9e1-4d22-9dc9-239d5191de6d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:04:40.800605 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-09039f5f-f9e1-4d22-9dc9-239d5191de6d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4178d34dc114f46af725c9dc362d224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d2b6a5a4534cadb34e626ce33238df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:04:40.803558 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-09039f5f-f9e1-4d22-9dc9-239d5191de6d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 200 len: 1372 microversion: 2.20 time: 0.142321 Jul 14 18:04:40.823401 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 533/1107] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:04:40 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 18:04:41.832763 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-0f885edd-4136-45c8-9b1e-045ee2da684a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:04:41.833480 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-0f885edd-4136-45c8-9b1e-045ee2da684a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:04:41.839982 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0f885edd-4136-45c8-9b1e-045ee2da684a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:41.840441 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0f885edd-4136-45c8-9b1e-045ee2da684a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:41.841233 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0f885edd-4136-45c8-9b1e-045ee2da684a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:41.841675 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0f885edd-4136-45c8-9b1e-045ee2da684a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:41.856217 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.wsgi [None req-0f885edd-4136-45c8-9b1e-045ee2da684a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] HTTP exception thrown: Instance 509b127f-76cb-4358-84a9-457d4e0397ec could not be found. Jul 14 18:04:41.857913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-0f885edd-4136-45c8-9b1e-045ee2da684a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Request method failure captured: Jul 14 18:04:41.857913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: request: GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec HTTP/1.1 Jul 14 18:04:41.857913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept: application/json Jul 14 18:04:41.857913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept-Encoding: identity Jul 14 18:04:41.857913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Connection: close Jul 14 18:04:41.857913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Length: 0 Jul 14 18:04:41.857913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Type: application/json Jul 14 18:04:41.857913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Host: 10.222.0.64 Jul 14 18:04:41.857913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Openstack-System-Scope: None Jul 14 18:04:41.857913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: User-Agent: python-urllib3/1.26.9 Jul 14 18:04:41.857913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Auth-Token: gAAAAABi0FfE5MuSI_VYn8C55vxjdjViweviO2tTL2hr1UT0KTMrHB8Mlsukvh_CoxX5RDoRa5rIIBSZfoPfBiCoI12cxvQ70gEoYzW3NUlxZdV7qaNavnh9M81ALJl1S3bTr2XAX4jL71VgamrBc8b-3Nz54CftGZ84y-R1u8obuTKiBocbg-Q Jul 14 18:04:41.857913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Id: None Jul 14 18:04:41.857913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Name: None Jul 14 18:04:41.857913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Identity-Status: Confirmed Jul 14 18:04:41.857913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Is-Admin-Project: True Jul 14 18:04:41.857913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 18:04:41.857913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Id: default Jul 14 18:04:41.857913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Name: Default Jul 14 18:04:41.857913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Id: 69d2b6a5a4534cadb34e626ce33238df Jul 14 18:04:41.857913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-91231765 Jul 14 18:04:41.857913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Role: reader,member Jul 14 18:04:41.857913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Roles: reader,member Jul 14 18:04:41.859895 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/69d2b6a5a4534cadb34e626ce33238df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/69d2b6a5a4534cadb34e626ce33238df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/69d2b6a5a4534cadb34e626ce33238df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_69d2b6a5a4534cadb34e626ce33238df", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:04:41.859895 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant: tempest-AttachVolumeShelveTestJSON-91231765 Jul 14 18:04:41.859895 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Id: 69d2b6a5a4534cadb34e626ce33238df Jul 14 18:04:41.859895 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-91231765 Jul 14 18:04:41.859895 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User: tempest-AttachVolumeShelveTestJSON-91231765-project Jul 14 18:04:41.859895 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Id: default Jul 14 18:04:41.859895 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Name: Default Jul 14 18:04:41.859895 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Id: c4178d34dc114f46af725c9dc362d224 Jul 14 18:04:41.859895 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Name: tempest-AttachVolumeShelveTestJSON-91231765-project Jul 14 18:04:41.859895 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: method: > Jul 14 18:04:41.859895 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: exception: Instance 509b127f-76cb-4358-84a9-457d4e0397ec could not be found. Jul 14 18:04:41.859895 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: action_args: {'id': '509b127f-76cb-4358-84a9-457d4e0397ec'} Jul 14 18:04:41.860914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:04:41.860914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:04:41.860914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 18:04:41.860914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 18:04:41.860914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 18:04:41.860914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 18:04:41.860914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 18:04:41.860914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 18:04:41.860914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 18:04:41.860914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 18:04:41.860914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 509b127f-76cb-4358-84a9-457d4e0397ec could not be found. Jul 14 18:04:41.860914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:04:41.860914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:04:41.860914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:04:41.860914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:04:41.860914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:04:41.860914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:04:41.860914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:04:41.860914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:04:41.860914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:04:41.862525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:04:41.862525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 18:04:41.862525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 18:04:41.862525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 18:04:41.862525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 18:04:41.862525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 18:04:41.862525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 18:04:41.862525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 509b127f-76cb-4358-84a9-457d4e0397ec could not be found. Jul 14 18:04:41.862525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:04:41.862525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:04:41.862525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:04:41.862525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:04:41.862525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:04:41.862525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:04:41.862525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 18:04:41.862525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 18:04:41.862525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 509b127f-76cb-4358-84a9-457d4e0397ec could not be found. Jul 14 18:04:41.862525 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:04:41.863997 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-0f885edd-4136-45c8-9b1e-045ee2da684a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Returning 404 to user: Instance 509b127f-76cb-4358-84a9-457d4e0397ec could not be found. {{(pid=129471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:04:41.863997 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-0f885edd-4136-45c8-9b1e-045ee2da684a tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 404 len: 111 microversion: 2.20 time: 0.032320 Jul 14 18:04:41.863997 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 575/1108] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:04:41 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 18:04:41.869305 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-e85f4b8e-fa6d-48d0-9710-938afdb46a47 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '.version_select at 0x7f1380133550>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:04:41.887211 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-e85f4b8e-fa6d-48d0-9710-938afdb46a47 tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1405162792" status: 204 len: 0 microversion: 2.20 time: 0.022336 Jul 14 18:04:41.888180 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 534/1109] 10.222.0.64 () {60 vars in 1261 bytes} [Thu Jul 14 18:04:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1405162792 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 14 18:04:43.717220 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-e0961a5b-bff5-4006-b77b-3cd7510efeeb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:04:43.717800 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-e0961a5b-bff5-4006-b77b-3cd7510efeeb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:04:43.724596 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e0961a5b-bff5-4006-b77b-3cd7510efeeb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:43.725044 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e0961a5b-bff5-4006-b77b-3cd7510efeeb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:43.725826 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e0961a5b-bff5-4006-b77b-3cd7510efeeb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:43.726270 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e0961a5b-bff5-4006-b77b-3cd7510efeeb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:43.741808 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.wsgi [None req-e0961a5b-bff5-4006-b77b-3cd7510efeeb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] HTTP exception thrown: Instance 509b127f-76cb-4358-84a9-457d4e0397ec could not be found. Jul 14 18:04:43.743413 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-e0961a5b-bff5-4006-b77b-3cd7510efeeb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Request method failure captured: Jul 14 18:04:43.743413 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: request: DELETE /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec HTTP/1.1 Jul 14 18:04:43.743413 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept: application/json Jul 14 18:04:43.743413 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept-Encoding: identity Jul 14 18:04:43.743413 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Connection: close Jul 14 18:04:43.743413 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Length: 0 Jul 14 18:04:43.743413 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Type: application/json Jul 14 18:04:43.743413 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Host: 10.222.0.64 Jul 14 18:04:43.743413 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Openstack-System-Scope: None Jul 14 18:04:43.743413 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: User-Agent: python-urllib3/1.26.9 Jul 14 18:04:43.743413 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Auth-Token: gAAAAABi0FfE5MuSI_VYn8C55vxjdjViweviO2tTL2hr1UT0KTMrHB8Mlsukvh_CoxX5RDoRa5rIIBSZfoPfBiCoI12cxvQ70gEoYzW3NUlxZdV7qaNavnh9M81ALJl1S3bTr2XAX4jL71VgamrBc8b-3Nz54CftGZ84y-R1u8obuTKiBocbg-Q Jul 14 18:04:43.743413 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Id: None Jul 14 18:04:43.743413 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Name: None Jul 14 18:04:43.743413 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Identity-Status: Confirmed Jul 14 18:04:43.743413 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Is-Admin-Project: True Jul 14 18:04:43.743413 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 18:04:43.743413 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Id: default Jul 14 18:04:43.743413 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Name: Default Jul 14 18:04:43.743413 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Id: 69d2b6a5a4534cadb34e626ce33238df Jul 14 18:04:43.743413 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-91231765 Jul 14 18:04:43.743413 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Role: reader,member Jul 14 18:04:43.743413 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Roles: reader,member Jul 14 18:04:43.745638 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/69d2b6a5a4534cadb34e626ce33238df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/69d2b6a5a4534cadb34e626ce33238df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/69d2b6a5a4534cadb34e626ce33238df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_69d2b6a5a4534cadb34e626ce33238df", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:04:43.745638 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant: tempest-AttachVolumeShelveTestJSON-91231765 Jul 14 18:04:43.745638 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Id: 69d2b6a5a4534cadb34e626ce33238df Jul 14 18:04:43.745638 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-91231765 Jul 14 18:04:43.745638 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User: tempest-AttachVolumeShelveTestJSON-91231765-project Jul 14 18:04:43.745638 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Id: default Jul 14 18:04:43.745638 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Name: Default Jul 14 18:04:43.745638 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Id: c4178d34dc114f46af725c9dc362d224 Jul 14 18:04:43.745638 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Name: tempest-AttachVolumeShelveTestJSON-91231765-project Jul 14 18:04:43.745638 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: method: > Jul 14 18:04:43.745638 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: exception: Instance 509b127f-76cb-4358-84a9-457d4e0397ec could not be found. Jul 14 18:04:43.745638 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: action_args: {'id': '509b127f-76cb-4358-84a9-457d4e0397ec'} Jul 14 18:04:43.746754 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:04:43.746754 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:04:43.746754 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 18:04:43.746754 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 18:04:43.746754 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 18:04:43.746754 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 18:04:43.746754 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 18:04:43.746754 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 18:04:43.746754 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 18:04:43.746754 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 18:04:43.746754 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 509b127f-76cb-4358-84a9-457d4e0397ec could not be found. Jul 14 18:04:43.746754 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:04:43.746754 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:04:43.746754 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:04:43.746754 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:04:43.746754 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:04:43.746754 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:04:43.746754 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:04:43.746754 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:04:43.746754 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:04:43.749014 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:04:43.749014 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 18:04:43.749014 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 18:04:43.749014 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 18:04:43.749014 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 18:04:43.749014 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 18:04:43.749014 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 18:04:43.749014 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 18:04:43.749014 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 18:04:43.749014 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 509b127f-76cb-4358-84a9-457d4e0397ec could not be found. Jul 14 18:04:43.749014 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:04:43.749014 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:04:43.749014 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:04:43.749014 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:04:43.749014 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:04:43.749014 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:04:43.749014 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 18:04:43.749014 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 18:04:43.749014 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 509b127f-76cb-4358-84a9-457d4e0397ec could not be found. Jul 14 18:04:43.749014 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:04:43.750797 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-e0961a5b-bff5-4006-b77b-3cd7510efeeb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Returning 404 to user: Instance 509b127f-76cb-4358-84a9-457d4e0397ec could not be found. {{(pid=129471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:04:43.750797 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-e0961a5b-bff5-4006-b77b-3cd7510efeeb tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "DELETE /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 404 len: 111 microversion: 2.20 time: 0.031607 Jul 14 18:04:43.750797 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 576/1110] 10.222.0.64 () {60 vars in 1279 bytes} [Thu Jul 14 18:04:43 2022] DELETE /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 18:04:43.756530 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-86a85d42-e799-4d1c-a7f0-1dbe6cb23c7d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:04:43.757180 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-86a85d42-e799-4d1c-a7f0-1dbe6cb23c7d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: 509b127f-76cb-4358-84a9-457d4e0397ec] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:04:43.768005 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-86a85d42-e799-4d1c-a7f0-1dbe6cb23c7d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:43.768465 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-86a85d42-e799-4d1c-a7f0-1dbe6cb23c7d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:43.769258 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-86a85d42-e799-4d1c-a7f0-1dbe6cb23c7d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:43.769702 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-86a85d42-e799-4d1c-a7f0-1dbe6cb23c7d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:43.784086 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.wsgi [None req-86a85d42-e799-4d1c-a7f0-1dbe6cb23c7d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] HTTP exception thrown: Instance 509b127f-76cb-4358-84a9-457d4e0397ec could not be found. Jul 14 18:04:43.785700 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-86a85d42-e799-4d1c-a7f0-1dbe6cb23c7d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Request method failure captured: Jul 14 18:04:43.785700 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: request: GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec HTTP/1.1 Jul 14 18:04:43.785700 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept: application/json Jul 14 18:04:43.785700 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept-Encoding: identity Jul 14 18:04:43.785700 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Connection: close Jul 14 18:04:43.785700 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Length: 0 Jul 14 18:04:43.785700 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Type: application/json Jul 14 18:04:43.785700 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Host: 10.222.0.64 Jul 14 18:04:43.785700 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Openstack-System-Scope: None Jul 14 18:04:43.785700 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: User-Agent: python-urllib3/1.26.9 Jul 14 18:04:43.785700 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Auth-Token: gAAAAABi0FfE5MuSI_VYn8C55vxjdjViweviO2tTL2hr1UT0KTMrHB8Mlsukvh_CoxX5RDoRa5rIIBSZfoPfBiCoI12cxvQ70gEoYzW3NUlxZdV7qaNavnh9M81ALJl1S3bTr2XAX4jL71VgamrBc8b-3Nz54CftGZ84y-R1u8obuTKiBocbg-Q Jul 14 18:04:43.785700 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Id: None Jul 14 18:04:43.785700 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Name: None Jul 14 18:04:43.785700 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Identity-Status: Confirmed Jul 14 18:04:43.785700 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Is-Admin-Project: True Jul 14 18:04:43.785700 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 18:04:43.785700 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Id: default Jul 14 18:04:43.785700 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Name: Default Jul 14 18:04:43.785700 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Id: 69d2b6a5a4534cadb34e626ce33238df Jul 14 18:04:43.785700 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-91231765 Jul 14 18:04:43.785700 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Role: reader,member Jul 14 18:04:43.785700 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Roles: reader,member Jul 14 18:04:43.787718 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/69d2b6a5a4534cadb34e626ce33238df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/69d2b6a5a4534cadb34e626ce33238df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/69d2b6a5a4534cadb34e626ce33238df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_69d2b6a5a4534cadb34e626ce33238df", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:04:43.787718 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant: tempest-AttachVolumeShelveTestJSON-91231765 Jul 14 18:04:43.787718 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Id: 69d2b6a5a4534cadb34e626ce33238df Jul 14 18:04:43.787718 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-91231765 Jul 14 18:04:43.787718 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User: tempest-AttachVolumeShelveTestJSON-91231765-project Jul 14 18:04:43.787718 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Id: default Jul 14 18:04:43.787718 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Name: Default Jul 14 18:04:43.787718 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Id: c4178d34dc114f46af725c9dc362d224 Jul 14 18:04:43.787718 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Name: tempest-AttachVolumeShelveTestJSON-91231765-project Jul 14 18:04:43.787718 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: method: > Jul 14 18:04:43.787718 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: exception: Instance 509b127f-76cb-4358-84a9-457d4e0397ec could not be found. Jul 14 18:04:43.787718 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: action_args: {'id': '509b127f-76cb-4358-84a9-457d4e0397ec'} Jul 14 18:04:43.788725 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:04:43.788725 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:04:43.788725 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 18:04:43.788725 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 18:04:43.788725 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 18:04:43.788725 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 18:04:43.788725 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 18:04:43.788725 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 18:04:43.788725 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 18:04:43.788725 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 18:04:43.788725 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 509b127f-76cb-4358-84a9-457d4e0397ec could not be found. Jul 14 18:04:43.788725 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:04:43.788725 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:04:43.788725 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:04:43.788725 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:04:43.788725 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:04:43.788725 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:04:43.788725 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:04:43.788725 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:04:43.788725 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:04:43.790866 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:04:43.790866 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 18:04:43.790866 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 18:04:43.790866 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 18:04:43.790866 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 18:04:43.790866 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 18:04:43.790866 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 18:04:43.790866 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 509b127f-76cb-4358-84a9-457d4e0397ec could not be found. Jul 14 18:04:43.790866 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:04:43.790866 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:04:43.790866 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:04:43.790866 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:04:43.790866 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:04:43.790866 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:04:43.790866 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 18:04:43.790866 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 18:04:43.790866 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 509b127f-76cb-4358-84a9-457d4e0397ec could not be found. Jul 14 18:04:43.790866 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:04:43.792408 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-86a85d42-e799-4d1c-a7f0-1dbe6cb23c7d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Returning 404 to user: Instance 509b127f-76cb-4358-84a9-457d4e0397ec could not be found. {{(pid=129470) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:04:43.792408 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-86a85d42-e799-4d1c-a7f0-1dbe6cb23c7d tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec" status: 404 len: 111 microversion: 2.20 time: 0.035022 Jul 14 18:04:43.792408 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 535/1111] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:04:43 2022] GET /compute/v2.1/servers/509b127f-76cb-4358-84a9-457d4e0397ec => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 18:04:44.958080 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-144f2fc4-ae49-4cd7-8060-fa84c86eef8b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:04:44.959019 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-144f2fc4-ae49-4cd7-8060-fa84c86eef8b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:04:44.966464 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-144f2fc4-ae49-4cd7-8060-fa84c86eef8b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:44.967001 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-144f2fc4-ae49-4cd7-8060-fa84c86eef8b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:44.967897 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-144f2fc4-ae49-4cd7-8060-fa84c86eef8b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:44.968501 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-144f2fc4-ae49-4cd7-8060-fa84c86eef8b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:44.992477 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.wsgi [None req-144f2fc4-ae49-4cd7-8060-fa84c86eef8b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] HTTP exception thrown: Instance afa45fb8-7566-483d-95ce-8f0242138b17 could not be found. Jul 14 18:04:44.996337 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-144f2fc4-ae49-4cd7-8060-fa84c86eef8b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Request method failure captured: Jul 14 18:04:44.996337 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: request: DELETE /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 HTTP/1.1 Jul 14 18:04:44.996337 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept: application/json Jul 14 18:04:44.996337 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept-Encoding: identity Jul 14 18:04:44.996337 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Connection: close Jul 14 18:04:44.996337 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Length: 0 Jul 14 18:04:44.996337 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Type: application/json Jul 14 18:04:44.996337 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Host: 10.222.0.64 Jul 14 18:04:44.996337 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Openstack-System-Scope: None Jul 14 18:04:44.996337 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: User-Agent: python-urllib3/1.26.9 Jul 14 18:04:44.996337 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Auth-Token: gAAAAABi0FfE5MuSI_VYn8C55vxjdjViweviO2tTL2hr1UT0KTMrHB8Mlsukvh_CoxX5RDoRa5rIIBSZfoPfBiCoI12cxvQ70gEoYzW3NUlxZdV7qaNavnh9M81ALJl1S3bTr2XAX4jL71VgamrBc8b-3Nz54CftGZ84y-R1u8obuTKiBocbg-Q Jul 14 18:04:44.996337 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Id: None Jul 14 18:04:44.996337 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Name: None Jul 14 18:04:44.996337 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Identity-Status: Confirmed Jul 14 18:04:44.996337 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Is-Admin-Project: True Jul 14 18:04:44.996337 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 18:04:44.996337 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Id: default Jul 14 18:04:44.996337 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Name: Default Jul 14 18:04:44.996337 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Id: 69d2b6a5a4534cadb34e626ce33238df Jul 14 18:04:44.996337 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-91231765 Jul 14 18:04:44.996337 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Role: reader,member Jul 14 18:04:44.996337 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Roles: reader,member Jul 14 18:04:44.998974 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/69d2b6a5a4534cadb34e626ce33238df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/69d2b6a5a4534cadb34e626ce33238df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/69d2b6a5a4534cadb34e626ce33238df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_69d2b6a5a4534cadb34e626ce33238df", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:04:44.998974 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant: tempest-AttachVolumeShelveTestJSON-91231765 Jul 14 18:04:44.998974 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Id: 69d2b6a5a4534cadb34e626ce33238df Jul 14 18:04:44.998974 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-91231765 Jul 14 18:04:44.998974 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User: tempest-AttachVolumeShelveTestJSON-91231765-project Jul 14 18:04:44.998974 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Id: default Jul 14 18:04:44.998974 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Name: Default Jul 14 18:04:44.998974 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Id: c4178d34dc114f46af725c9dc362d224 Jul 14 18:04:44.998974 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Name: tempest-AttachVolumeShelveTestJSON-91231765-project Jul 14 18:04:44.998974 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: method: > Jul 14 18:04:44.998974 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: exception: Instance afa45fb8-7566-483d-95ce-8f0242138b17 could not be found. Jul 14 18:04:44.998974 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: action_args: {'id': 'afa45fb8-7566-483d-95ce-8f0242138b17'} Jul 14 18:04:45.000757 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:04:45.000757 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:04:45.000757 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 18:04:45.000757 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 18:04:45.000757 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 18:04:45.000757 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 18:04:45.000757 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 18:04:45.000757 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 18:04:45.000757 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 18:04:45.000757 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 18:04:45.000757 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afa45fb8-7566-483d-95ce-8f0242138b17 could not be found. Jul 14 18:04:45.000757 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:04:45.000757 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:04:45.000757 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:04:45.000757 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:04:45.000757 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:04:45.000757 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:04:45.000757 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:04:45.000757 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:04:45.000757 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:04:45.003328 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:04:45.003328 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 18:04:45.003328 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 18:04:45.003328 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 18:04:45.003328 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 18:04:45.003328 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 18:04:45.003328 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 18:04:45.003328 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 18:04:45.003328 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 18:04:45.003328 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afa45fb8-7566-483d-95ce-8f0242138b17 could not be found. Jul 14 18:04:45.003328 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:04:45.003328 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:04:45.003328 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:04:45.003328 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:04:45.003328 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:04:45.003328 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:04:45.003328 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 18:04:45.003328 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 18:04:45.003328 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afa45fb8-7566-483d-95ce-8f0242138b17 could not be found. Jul 14 18:04:45.003328 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:04:45.006324 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-144f2fc4-ae49-4cd7-8060-fa84c86eef8b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Returning 404 to user: Instance afa45fb8-7566-483d-95ce-8f0242138b17 could not be found. {{(pid=129471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:04:45.006324 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-144f2fc4-ae49-4cd7-8060-fa84c86eef8b tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "DELETE /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 404 len: 111 microversion: 2.20 time: 0.044832 Jul 14 18:04:45.006324 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 577/1112] 10.222.0.64 () {60 vars in 1279 bytes} [Thu Jul 14 18:04:44 2022] DELETE /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 14 18:04:45.013587 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-4df9805e-3412-4617-b527-892c3bfc308e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:04:45.014275 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-4df9805e-3412-4617-b527-892c3bfc308e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] [instance: afa45fb8-7566-483d-95ce-8f0242138b17] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:04:45.026615 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4df9805e-3412-4617-b527-892c3bfc308e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:45.027432 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4df9805e-3412-4617-b527-892c3bfc308e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:45.028950 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4df9805e-3412-4617-b527-892c3bfc308e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:04:45.029900 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4df9805e-3412-4617-b527-892c3bfc308e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:04:45.058471 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.wsgi [None req-4df9805e-3412-4617-b527-892c3bfc308e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] HTTP exception thrown: Instance afa45fb8-7566-483d-95ce-8f0242138b17 could not be found. Jul 14 18:04:45.061868 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-4df9805e-3412-4617-b527-892c3bfc308e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Request method failure captured: Jul 14 18:04:45.061868 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: request: GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 HTTP/1.1 Jul 14 18:04:45.061868 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept: application/json Jul 14 18:04:45.061868 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept-Encoding: identity Jul 14 18:04:45.061868 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Connection: close Jul 14 18:04:45.061868 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Length: 0 Jul 14 18:04:45.061868 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Type: application/json Jul 14 18:04:45.061868 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Host: 10.222.0.64 Jul 14 18:04:45.061868 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Openstack-System-Scope: None Jul 14 18:04:45.061868 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: User-Agent: python-urllib3/1.26.9 Jul 14 18:04:45.061868 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Auth-Token: gAAAAABi0FfE5MuSI_VYn8C55vxjdjViweviO2tTL2hr1UT0KTMrHB8Mlsukvh_CoxX5RDoRa5rIIBSZfoPfBiCoI12cxvQ70gEoYzW3NUlxZdV7qaNavnh9M81ALJl1S3bTr2XAX4jL71VgamrBc8b-3Nz54CftGZ84y-R1u8obuTKiBocbg-Q Jul 14 18:04:45.061868 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Id: None Jul 14 18:04:45.061868 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Name: None Jul 14 18:04:45.061868 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Identity-Status: Confirmed Jul 14 18:04:45.061868 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Is-Admin-Project: True Jul 14 18:04:45.061868 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 18:04:45.061868 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Id: default Jul 14 18:04:45.061868 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Name: Default Jul 14 18:04:45.061868 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Id: 69d2b6a5a4534cadb34e626ce33238df Jul 14 18:04:45.061868 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-91231765 Jul 14 18:04:45.061868 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Role: reader,member Jul 14 18:04:45.061868 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Roles: reader,member Jul 14 18:04:45.064592 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/69d2b6a5a4534cadb34e626ce33238df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/69d2b6a5a4534cadb34e626ce33238df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/69d2b6a5a4534cadb34e626ce33238df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_69d2b6a5a4534cadb34e626ce33238df", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:04:45.064592 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant: tempest-AttachVolumeShelveTestJSON-91231765 Jul 14 18:04:45.064592 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Id: 69d2b6a5a4534cadb34e626ce33238df Jul 14 18:04:45.064592 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-91231765 Jul 14 18:04:45.064592 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User: tempest-AttachVolumeShelveTestJSON-91231765-project Jul 14 18:04:45.064592 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Id: default Jul 14 18:04:45.064592 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Name: Default Jul 14 18:04:45.064592 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Id: c4178d34dc114f46af725c9dc362d224 Jul 14 18:04:45.064592 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Name: tempest-AttachVolumeShelveTestJSON-91231765-project Jul 14 18:04:45.064592 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: method: > Jul 14 18:04:45.064592 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: exception: Instance afa45fb8-7566-483d-95ce-8f0242138b17 could not be found. Jul 14 18:04:45.064592 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: action_args: {'id': 'afa45fb8-7566-483d-95ce-8f0242138b17'} Jul 14 18:04:45.065454 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:04:45.065454 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:04:45.065454 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 18:04:45.065454 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 18:04:45.065454 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 18:04:45.065454 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 18:04:45.065454 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 18:04:45.065454 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 18:04:45.065454 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 18:04:45.065454 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 18:04:45.065454 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afa45fb8-7566-483d-95ce-8f0242138b17 could not be found. Jul 14 18:04:45.065454 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:04:45.065454 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:04:45.065454 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:04:45.065454 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:04:45.065454 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:04:45.065454 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:04:45.065454 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:04:45.065454 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:04:45.065454 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:04:45.067066 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:04:45.067066 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 18:04:45.067066 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 18:04:45.067066 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 18:04:45.067066 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 18:04:45.067066 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 18:04:45.067066 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 18:04:45.067066 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afa45fb8-7566-483d-95ce-8f0242138b17 could not be found. Jul 14 18:04:45.067066 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:04:45.067066 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:04:45.067066 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:04:45.067066 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:04:45.067066 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:04:45.067066 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:04:45.067066 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 18:04:45.067066 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 18:04:45.067066 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afa45fb8-7566-483d-95ce-8f0242138b17 could not be found. Jul 14 18:04:45.067066 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:04:45.068595 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-4df9805e-3412-4617-b527-892c3bfc308e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] Returning 404 to user: Instance afa45fb8-7566-483d-95ce-8f0242138b17 could not be found. {{(pid=129470) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:04:45.068595 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-4df9805e-3412-4617-b527-892c3bfc308e tempest-AttachVolumeShelveTestJSON-91231765 tempest-AttachVolumeShelveTestJSON-91231765-project] 10.222.0.64 "GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17" status: 404 len: 111 microversion: 2.20 time: 0.057710 Jul 14 18:04:45.068595 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 536/1113] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Jul 14 18:04:45 2022] GET /compute/v2.1/servers/afa45fb8-7566-483d-95ce-8f0242138b17 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 18:04:50.086198 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-3a58f9f3-d35a-4643-bd73-50664f346fa3 tempest-VolumesNegativeTest-1572680148 tempest-VolumesNegativeTest-1572680148-project] Action: 'create', calling method: .version_select at 0x7f137b6cba60>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-149687585", "metadata": {"Type": "work"}}} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:04:50.110448 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-3a58f9f3-d35a-4643-bd73-50664f346fa3 tempest-VolumesNegativeTest-1572680148 tempest-VolumesNegativeTest-1572680148-project] Request method failure captured: Jul 14 18:04:50.110448 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 18:04:50.110448 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept: application/json Jul 14 18:04:50.110448 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept-Encoding: identity Jul 14 18:04:50.110448 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Connection: close Jul 14 18:04:50.110448 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Length: 121 Jul 14 18:04:50.110448 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Type: application/json Jul 14 18:04:50.110448 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Host: 10.222.0.64 Jul 14 18:04:50.110448 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Openstack-System-Scope: None Jul 14 18:04:50.110448 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: User-Agent: python-urllib3/1.26.9 Jul 14 18:04:50.110448 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Auth-Token: gAAAAABi0FrB2Apwjb1ZRuN_QBHANsIlq-GKGY_JKiPTRuyn8boPlnFmF4hhH5JkJ_kJuDHDtODHyVNwUilMH2NDEF9p-ITnPbvxTdvTFdZ5EuPclMoBjRBw2JWZmCqhOAhsnd8PXr6PwoCTkNKmHFUuPfRRCOi23HX7ukjyFqepsAK193e8LWQ Jul 14 18:04:50.110448 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Id: None Jul 14 18:04:50.110448 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Name: None Jul 14 18:04:50.110448 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Identity-Status: Confirmed Jul 14 18:04:50.110448 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Is-Admin-Project: True Jul 14 18:04:50.110448 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Id: default Jul 14 18:04:50.110448 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Name: Default Jul 14 18:04:50.110448 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Id: 94b41787eebf4dc68871f38ff4ba12a8 Jul 14 18:04:50.110448 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Name: tempest-VolumesNegativeTest-1572680148 Jul 14 18:04:50.110448 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Role: reader,member Jul 14 18:04:50.110448 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Roles: reader,member Jul 14 18:04:50.113200 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/94b41787eebf4dc68871f38ff4ba12a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/94b41787eebf4dc68871f38ff4ba12a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/94b41787eebf4dc68871f38ff4ba12a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_94b41787eebf4dc68871f38ff4ba12a8", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:04:50.113200 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant: tempest-VolumesNegativeTest-1572680148 Jul 14 18:04:50.113200 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Id: 94b41787eebf4dc68871f38ff4ba12a8 Jul 14 18:04:50.113200 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Name: tempest-VolumesNegativeTest-1572680148 Jul 14 18:04:50.113200 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User: tempest-VolumesNegativeTest-1572680148-project Jul 14 18:04:50.113200 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Id: default Jul 14 18:04:50.113200 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Name: Default Jul 14 18:04:50.113200 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Id: c638a5ecc911478eaeb64aedd8d4c656 Jul 14 18:04:50.113200 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Name: tempest-VolumesNegativeTest-1572680148-project Jul 14 18:04:50.113200 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Jul 14 18:04:50.113200 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-149687585", "metadata": {"Type": "work"}}} Jul 14 18:04:50.113200 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: method: Jul 14 18:04:50.113200 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 18:04:50.115097 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-149687585', 'metadata': {'Type': 'work'}}}} Jul 14 18:04:50.115097 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:04:50.115097 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:04:50.115097 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 18:04:50.115097 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 18:04:50.115097 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 18:04:50.115097 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise error Jul 14 18:04:50.115097 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 14 18:04:50.115097 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.115097 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 14 18:04:50.115097 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 18:04:50.115097 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.115097 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 18:04:50.115097 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi '#$%' Jul 14 18:04:50.115097 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.115097 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:04:50.115097 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.115097 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:04:50.115097 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:04:50.115097 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:04:50.115097 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:04:50.115097 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:04:50.119836 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 18:04:50.119836 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 18:04:50.119836 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:04:50.119836 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:04:50.119836 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 18:04:50.119836 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 18:04:50.119836 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 18:04:50.119836 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 18:04:50.119836 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 18:04:50.119836 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 18:04:50.119836 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 18:04:50.119836 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.119836 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:04:50.119836 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.119836 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:04:50.119836 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:04:50.119836 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:04:50.119836 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 18:04:50.119836 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 18:04:50.122189 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 18:04:50.122189 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.122189 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-3a58f9f3-d35a-4643-bd73-50664f346fa3 tempest-VolumesNegativeTest-1572680148 tempest-VolumesNegativeTest-1572680148-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:04:50.122189 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-3a58f9f3-d35a-4643-bd73-50664f346fa3 tempest-VolumesNegativeTest-1572680148 tempest-VolumesNegativeTest-1572680148-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.152704 Jul 14 18:04:50.122189 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 578/1114] 10.222.0.64 () {60 vars in 1155 bytes} [Thu Jul 14 18:04:49 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 154 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 18:04:50.124641 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-5e8aa667-dbf7-4b42-aede-6f59c3d9a6aa tempest-VolumesNegativeTest-1572680148 tempest-VolumesNegativeTest-1572680148-project] Action: 'create', calling method: .version_select at 0x7f13801335e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1382989447", "metadata": {"Type": "work"}}} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:04:50.128112 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-5e8aa667-dbf7-4b42-aede-6f59c3d9a6aa tempest-VolumesNegativeTest-1572680148 tempest-VolumesNegativeTest-1572680148-project] Request method failure captured: Jul 14 18:04:50.128112 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 18:04:50.128112 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept: application/json Jul 14 18:04:50.128112 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept-Encoding: identity Jul 14 18:04:50.128112 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Connection: close Jul 14 18:04:50.128112 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Length: 120 Jul 14 18:04:50.128112 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Type: application/json Jul 14 18:04:50.128112 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Host: 10.222.0.64 Jul 14 18:04:50.128112 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Openstack-System-Scope: None Jul 14 18:04:50.128112 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: User-Agent: python-urllib3/1.26.9 Jul 14 18:04:50.128112 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Auth-Token: gAAAAABi0FrB2Apwjb1ZRuN_QBHANsIlq-GKGY_JKiPTRuyn8boPlnFmF4hhH5JkJ_kJuDHDtODHyVNwUilMH2NDEF9p-ITnPbvxTdvTFdZ5EuPclMoBjRBw2JWZmCqhOAhsnd8PXr6PwoCTkNKmHFUuPfRRCOi23HX7ukjyFqepsAK193e8LWQ Jul 14 18:04:50.128112 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Id: None Jul 14 18:04:50.128112 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Name: None Jul 14 18:04:50.128112 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Identity-Status: Confirmed Jul 14 18:04:50.128112 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Is-Admin-Project: True Jul 14 18:04:50.128112 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Id: default Jul 14 18:04:50.128112 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Name: Default Jul 14 18:04:50.128112 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Id: 94b41787eebf4dc68871f38ff4ba12a8 Jul 14 18:04:50.128112 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Name: tempest-VolumesNegativeTest-1572680148 Jul 14 18:04:50.128112 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Role: reader,member Jul 14 18:04:50.128112 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Roles: reader,member Jul 14 18:04:50.129884 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/94b41787eebf4dc68871f38ff4ba12a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/94b41787eebf4dc68871f38ff4ba12a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/94b41787eebf4dc68871f38ff4ba12a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_94b41787eebf4dc68871f38ff4ba12a8", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:04:50.129884 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant: tempest-VolumesNegativeTest-1572680148 Jul 14 18:04:50.129884 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Id: 94b41787eebf4dc68871f38ff4ba12a8 Jul 14 18:04:50.129884 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Name: tempest-VolumesNegativeTest-1572680148 Jul 14 18:04:50.129884 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User: tempest-VolumesNegativeTest-1572680148-project Jul 14 18:04:50.129884 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Id: default Jul 14 18:04:50.129884 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Name: Default Jul 14 18:04:50.129884 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Id: c638a5ecc911478eaeb64aedd8d4c656 Jul 14 18:04:50.129884 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Name: tempest-VolumesNegativeTest-1572680148-project Jul 14 18:04:50.129884 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Jul 14 18:04:50.129884 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1382989447", "metadata": {"Type": "work"}}} Jul 14 18:04:50.129884 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: method: Jul 14 18:04:50.129884 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 18:04:50.136019 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1382989447', 'metadata': {'Type': 'work'}}}} Jul 14 18:04:50.136019 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:04:50.136019 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:04:50.136019 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 18:04:50.136019 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 18:04:50.136019 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 18:04:50.136019 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise error Jul 14 18:04:50.136019 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 14 18:04:50.136019 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.136019 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 14 18:04:50.136019 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 18:04:50.136019 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.136019 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 18:04:50.136019 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi '0' Jul 14 18:04:50.136019 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.136019 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:04:50.136019 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.136019 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:04:50.136019 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:04:50.136019 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:04:50.136019 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:04:50.136019 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:04:50.137864 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 18:04:50.137864 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 18:04:50.137864 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:04:50.137864 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:04:50.137864 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 18:04:50.137864 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 18:04:50.137864 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 18:04:50.137864 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 18:04:50.137864 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 18:04:50.137864 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 18:04:50.137864 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 18:04:50.137864 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.137864 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:04:50.137864 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.137864 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:04:50.137864 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:04:50.137864 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:04:50.137864 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 18:04:50.137864 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 18:04:50.139156 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 18:04:50.139156 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.139156 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-5e8aa667-dbf7-4b42-aede-6f59c3d9a6aa tempest-VolumesNegativeTest-1572680148 tempest-VolumesNegativeTest-1572680148-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129470) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:04:50.139156 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-5e8aa667-dbf7-4b42-aede-6f59c3d9a6aa tempest-VolumesNegativeTest-1572680148 tempest-VolumesNegativeTest-1572680148-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008622 Jul 14 18:04:50.139156 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 537/1115] 10.222.0.64 () {60 vars in 1155 bytes} [Thu Jul 14 18:04:50 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 18:04:50.140584 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-a952fd57-5ae1-4369-8ef3-b0e83193f226 tempest-VolumesNegativeTest-1572680148 tempest-VolumesNegativeTest-1572680148-project] Action: 'create', calling method: .version_select at 0x7f137b607040>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-356618240", "metadata": {"Type": "work"}}} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:04:50.143904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-a952fd57-5ae1-4369-8ef3-b0e83193f226 tempest-VolumesNegativeTest-1572680148 tempest-VolumesNegativeTest-1572680148-project] Request method failure captured: Jul 14 18:04:50.143904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 18:04:50.143904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept: application/json Jul 14 18:04:50.143904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept-Encoding: identity Jul 14 18:04:50.143904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Connection: close Jul 14 18:04:50.143904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Length: 118 Jul 14 18:04:50.143904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Type: application/json Jul 14 18:04:50.143904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Host: 10.222.0.64 Jul 14 18:04:50.143904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Openstack-System-Scope: None Jul 14 18:04:50.143904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: User-Agent: python-urllib3/1.26.9 Jul 14 18:04:50.143904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Auth-Token: gAAAAABi0FrB2Apwjb1ZRuN_QBHANsIlq-GKGY_JKiPTRuyn8boPlnFmF4hhH5JkJ_kJuDHDtODHyVNwUilMH2NDEF9p-ITnPbvxTdvTFdZ5EuPclMoBjRBw2JWZmCqhOAhsnd8PXr6PwoCTkNKmHFUuPfRRCOi23HX7ukjyFqepsAK193e8LWQ Jul 14 18:04:50.143904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Id: None Jul 14 18:04:50.143904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Name: None Jul 14 18:04:50.143904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Identity-Status: Confirmed Jul 14 18:04:50.143904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Is-Admin-Project: True Jul 14 18:04:50.143904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Id: default Jul 14 18:04:50.143904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Name: Default Jul 14 18:04:50.143904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Id: 94b41787eebf4dc68871f38ff4ba12a8 Jul 14 18:04:50.143904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Name: tempest-VolumesNegativeTest-1572680148 Jul 14 18:04:50.143904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Role: reader,member Jul 14 18:04:50.143904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Roles: reader,member Jul 14 18:04:50.145293 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/94b41787eebf4dc68871f38ff4ba12a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/94b41787eebf4dc68871f38ff4ba12a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/94b41787eebf4dc68871f38ff4ba12a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_94b41787eebf4dc68871f38ff4ba12a8", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:04:50.145293 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant: tempest-VolumesNegativeTest-1572680148 Jul 14 18:04:50.145293 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Id: 94b41787eebf4dc68871f38ff4ba12a8 Jul 14 18:04:50.145293 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Name: tempest-VolumesNegativeTest-1572680148 Jul 14 18:04:50.145293 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User: tempest-VolumesNegativeTest-1572680148-project Jul 14 18:04:50.145293 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Id: default Jul 14 18:04:50.145293 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Name: Default Jul 14 18:04:50.145293 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Id: c638a5ecc911478eaeb64aedd8d4c656 Jul 14 18:04:50.145293 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Name: tempest-VolumesNegativeTest-1572680148-project Jul 14 18:04:50.145293 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Jul 14 18:04:50.145293 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-356618240", "metadata": {"Type": "work"}}} Jul 14 18:04:50.145293 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: method: Jul 14 18:04:50.145293 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 18:04:50.146404 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-356618240', 'metadata': {'Type': 'work'}}}} Jul 14 18:04:50.146404 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:04:50.146404 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:04:50.146404 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 18:04:50.146404 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 18:04:50.146404 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 18:04:50.146404 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise error Jul 14 18:04:50.146404 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 14 18:04:50.146404 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.146404 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 14 18:04:50.146404 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 18:04:50.146404 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.146404 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 18:04:50.146404 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi '' Jul 14 18:04:50.146404 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.146404 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:04:50.146404 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.146404 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:04:50.146404 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:04:50.146404 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:04:50.146404 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:04:50.146404 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:04:50.148498 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 18:04:50.148498 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 18:04:50.148498 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:04:50.148498 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:04:50.148498 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 18:04:50.148498 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 18:04:50.148498 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 18:04:50.148498 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 18:04:50.148498 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 18:04:50.148498 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 18:04:50.148498 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 18:04:50.148498 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.148498 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:04:50.148498 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.148498 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:04:50.148498 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:04:50.148498 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:04:50.148498 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 18:04:50.148498 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 18:04:50.149973 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 18:04:50.149973 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.149973 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-a952fd57-5ae1-4369-8ef3-b0e83193f226 tempest-VolumesNegativeTest-1572680148 tempest-VolumesNegativeTest-1572680148-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:04:50.149973 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-a952fd57-5ae1-4369-8ef3-b0e83193f226 tempest-VolumesNegativeTest-1572680148 tempest-VolumesNegativeTest-1572680148-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009456 Jul 14 18:04:50.149973 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 579/1116] 10.222.0.64 () {60 vars in 1155 bytes} [Thu Jul 14 18:04:50 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 18:04:50.156120 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-efc163d8-aaeb-47fe-99a5-c8f68b50e9f5 tempest-VolumesNegativeTest-1572680148 tempest-VolumesNegativeTest-1572680148-project] Calling method '.version_select at 0x7f13800ae430>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:04:50.193362 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.wsgi [None req-efc163d8-aaeb-47fe-99a5-c8f68b50e9f5 tempest-VolumesNegativeTest-1572680148 tempest-VolumesNegativeTest-1572680148-project] HTTP exception thrown: Volume tempest-invalid-424749382 could not be found. Jul 14 18:04:50.196169 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-efc163d8-aaeb-47fe-99a5-c8f68b50e9f5 tempest-VolumesNegativeTest-1572680148 tempest-VolumesNegativeTest-1572680148-project] Request method failure captured: Jul 14 18:04:50.196169 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-424749382 HTTP/1.1 Jul 14 18:04:50.196169 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept: application/json Jul 14 18:04:50.196169 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept-Encoding: identity Jul 14 18:04:50.196169 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Connection: close Jul 14 18:04:50.196169 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Length: 0 Jul 14 18:04:50.196169 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Type: application/json Jul 14 18:04:50.196169 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Host: 10.222.0.64 Jul 14 18:04:50.196169 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Openstack-System-Scope: None Jul 14 18:04:50.196169 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: User-Agent: python-urllib3/1.26.9 Jul 14 18:04:50.196169 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Auth-Token: gAAAAABi0FrB2Apwjb1ZRuN_QBHANsIlq-GKGY_JKiPTRuyn8boPlnFmF4hhH5JkJ_kJuDHDtODHyVNwUilMH2NDEF9p-ITnPbvxTdvTFdZ5EuPclMoBjRBw2JWZmCqhOAhsnd8PXr6PwoCTkNKmHFUuPfRRCOi23HX7ukjyFqepsAK193e8LWQ Jul 14 18:04:50.196169 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Id: None Jul 14 18:04:50.196169 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Name: None Jul 14 18:04:50.196169 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Identity-Status: Confirmed Jul 14 18:04:50.196169 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Is-Admin-Project: True Jul 14 18:04:50.196169 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Id: default Jul 14 18:04:50.196169 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Name: Default Jul 14 18:04:50.196169 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Id: 94b41787eebf4dc68871f38ff4ba12a8 Jul 14 18:04:50.196169 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Name: tempest-VolumesNegativeTest-1572680148 Jul 14 18:04:50.196169 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Role: reader,member Jul 14 18:04:50.196169 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Roles: reader,member Jul 14 18:04:50.199291 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/94b41787eebf4dc68871f38ff4ba12a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/94b41787eebf4dc68871f38ff4ba12a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/94b41787eebf4dc68871f38ff4ba12a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_94b41787eebf4dc68871f38ff4ba12a8", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:04:50.199291 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant: tempest-VolumesNegativeTest-1572680148 Jul 14 18:04:50.199291 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Id: 94b41787eebf4dc68871f38ff4ba12a8 Jul 14 18:04:50.199291 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Name: tempest-VolumesNegativeTest-1572680148 Jul 14 18:04:50.199291 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User: tempest-VolumesNegativeTest-1572680148-project Jul 14 18:04:50.199291 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Id: default Jul 14 18:04:50.199291 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Name: Default Jul 14 18:04:50.199291 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Id: c638a5ecc911478eaeb64aedd8d4c656 Jul 14 18:04:50.199291 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Name: tempest-VolumesNegativeTest-1572680148-project Jul 14 18:04:50.199291 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: method: Jul 14 18:04:50.199291 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: exception: Volume tempest-invalid-424749382 could not be found. Jul 14 18:04:50.199291 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: action_args: {'id': 'tempest-invalid-424749382'} Jul 14 18:04:50.199291 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:04:50.201275 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:04:50.201275 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 18:04:50.201275 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 18:04:50.201275 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 18:04:50.201275 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 18:04:50.201275 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 18:04:50.201275 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 18:04:50.201275 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 18:04:50.201275 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 18:04:50.201275 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 18:04:50.201275 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 18:04:50.201275 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 18:04:50.201275 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 18:04:50.201275 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 18:04:50.201275 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 18:04:50.201275 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-424749382 could not be found. (HTTP 404) (Request-ID: req-45469970-2c33-4f7e-8aeb-053993035632) Jul 14 18:04:50.201275 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.201275 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:04:50.201275 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.203680 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:04:50.203680 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 18:04:50.203680 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 18:04:50.203680 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 18:04:50.203680 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 18:04:50.203680 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 18:04:50.203680 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 18:04:50.203680 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 18:04:50.203680 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 18:04:50.203680 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 18:04:50.203680 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 18:04:50.203680 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 18:04:50.203680 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 18:04:50.203680 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 18:04:50.203680 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 18:04:50.203680 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 18:04:50.203680 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 18:04:50.203680 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 18:04:50.203680 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 18:04:50.206323 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 18:04:50.206323 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 18:04:50.206323 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 18:04:50.206323 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 18:04:50.206323 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-424749382 could not be found. Jul 14 18:04:50.206323 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.206323 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:04:50.206323 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.206323 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:04:50.206323 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:04:50.206323 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:04:50.206323 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:04:50.206323 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:04:50.206323 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 18:04:50.206323 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 18:04:50.206323 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:04:50.206323 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:04:50.206323 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 18:04:50.206323 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 18:04:50.206323 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-424749382 could not be found. Jul 14 18:04:50.208725 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.208725 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:04:50.208725 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.208725 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:04:50.208725 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:04:50.208725 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:04:50.208725 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 18:04:50.208725 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 18:04:50.208725 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-424749382 could not be found. Jul 14 18:04:50.208725 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.208725 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-efc163d8-aaeb-47fe-99a5-c8f68b50e9f5 tempest-VolumesNegativeTest-1572680148 tempest-VolumesNegativeTest-1572680148-project] Returning 404 to user: Volume tempest-invalid-424749382 could not be found. {{(pid=129470) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:04:50.208725 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-efc163d8-aaeb-47fe-99a5-c8f68b50e9f5 tempest-VolumesNegativeTest-1572680148 tempest-VolumesNegativeTest-1572680148-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/tempest-invalid-424749382" status: 404 len: 98 microversion: 2.1 time: 0.046199 Jul 14 18:04:50.208725 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 538/1117] 10.222.0.64 () {58 vars in 1214 bytes} [Thu Jul 14 18:04:50 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-424749382 => generated 98 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 18:04:50.212812 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-23d31403-2414-43f4-bfad-cd0723fb34c4 tempest-VolumesNegativeTest-1572680148 tempest-VolumesNegativeTest-1572680148-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005712 Jul 14 18:04:50.213339 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 580/1118] 10.222.0.64 () {58 vars in 1139 bytes} [Thu Jul 14 18:04:50 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 14 18:04:50.223387 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-cdebe211-c308-4ef9-bc6f-f63cb3e47bbf tempest-VolumesNegativeTest-1572680148 tempest-VolumesNegativeTest-1572680148-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003822 Jul 14 18:04:50.223821 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 539/1119] 10.222.0.64 () {58 vars in 1136 bytes} [Thu Jul 14 18:04:50 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 14 18:04:50.232925 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-d64b43bc-8870-45b8-b157-c5a052ca4236 tempest-VolumesNegativeTest-1572680148 tempest-VolumesNegativeTest-1572680148-project] Calling method '.version_select at 0x7f137b58aca0>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:04:50.262233 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.wsgi [None req-d64b43bc-8870-45b8-b157-c5a052ca4236 tempest-VolumesNegativeTest-1572680148 tempest-VolumesNegativeTest-1572680148-project] HTTP exception thrown: Volume 901e4d7b-8262-43cb-a0c8-fa0e73f13bcc could not be found. Jul 14 18:04:50.264434 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-d64b43bc-8870-45b8-b157-c5a052ca4236 tempest-VolumesNegativeTest-1572680148 tempest-VolumesNegativeTest-1572680148-project] Request method failure captured: Jul 14 18:04:50.264434 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: request: DELETE /compute/v2.1/os-volumes/901e4d7b-8262-43cb-a0c8-fa0e73f13bcc HTTP/1.1 Jul 14 18:04:50.264434 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept: application/json Jul 14 18:04:50.264434 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept-Encoding: identity Jul 14 18:04:50.264434 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Connection: close Jul 14 18:04:50.264434 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Length: 0 Jul 14 18:04:50.264434 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Type: application/json Jul 14 18:04:50.264434 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Host: 10.222.0.64 Jul 14 18:04:50.264434 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Openstack-System-Scope: None Jul 14 18:04:50.264434 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: User-Agent: python-urllib3/1.26.9 Jul 14 18:04:50.264434 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Auth-Token: gAAAAABi0FrB2Apwjb1ZRuN_QBHANsIlq-GKGY_JKiPTRuyn8boPlnFmF4hhH5JkJ_kJuDHDtODHyVNwUilMH2NDEF9p-ITnPbvxTdvTFdZ5EuPclMoBjRBw2JWZmCqhOAhsnd8PXr6PwoCTkNKmHFUuPfRRCOi23HX7ukjyFqepsAK193e8LWQ Jul 14 18:04:50.264434 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Id: None Jul 14 18:04:50.264434 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Name: None Jul 14 18:04:50.264434 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Identity-Status: Confirmed Jul 14 18:04:50.264434 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Is-Admin-Project: True Jul 14 18:04:50.264434 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Id: default Jul 14 18:04:50.264434 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Name: Default Jul 14 18:04:50.264434 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Id: 94b41787eebf4dc68871f38ff4ba12a8 Jul 14 18:04:50.264434 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Name: tempest-VolumesNegativeTest-1572680148 Jul 14 18:04:50.264434 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Role: reader,member Jul 14 18:04:50.264434 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Roles: reader,member Jul 14 18:04:50.266106 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/94b41787eebf4dc68871f38ff4ba12a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/94b41787eebf4dc68871f38ff4ba12a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/94b41787eebf4dc68871f38ff4ba12a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_94b41787eebf4dc68871f38ff4ba12a8", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:04:50.266106 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant: tempest-VolumesNegativeTest-1572680148 Jul 14 18:04:50.266106 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Id: 94b41787eebf4dc68871f38ff4ba12a8 Jul 14 18:04:50.266106 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Name: tempest-VolumesNegativeTest-1572680148 Jul 14 18:04:50.266106 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User: tempest-VolumesNegativeTest-1572680148-project Jul 14 18:04:50.266106 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Id: default Jul 14 18:04:50.266106 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Name: Default Jul 14 18:04:50.266106 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Id: c638a5ecc911478eaeb64aedd8d4c656 Jul 14 18:04:50.266106 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Name: tempest-VolumesNegativeTest-1572680148-project Jul 14 18:04:50.266106 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: method: Jul 14 18:04:50.266106 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: exception: Volume 901e4d7b-8262-43cb-a0c8-fa0e73f13bcc could not be found. Jul 14 18:04:50.266106 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: action_args: {'id': '901e4d7b-8262-43cb-a0c8-fa0e73f13bcc'} Jul 14 18:04:50.266106 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:04:50.267225 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:04:50.267225 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 18:04:50.267225 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 18:04:50.267225 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 18:04:50.267225 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 18:04:50.267225 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 18:04:50.267225 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 18:04:50.267225 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 18:04:50.267225 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 18:04:50.267225 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 18:04:50.267225 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 18:04:50.267225 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 18:04:50.267225 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 18:04:50.267225 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 18:04:50.267225 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 18:04:50.267225 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 901e4d7b-8262-43cb-a0c8-fa0e73f13bcc could not be found. (HTTP 404) (Request-ID: req-07eb32e4-4dc8-4b77-ba64-ac4c2b91fe90) Jul 14 18:04:50.267225 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.267225 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:04:50.267225 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.268880 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:04:50.268880 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 18:04:50.268880 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 18:04:50.268880 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 18:04:50.268880 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 18:04:50.268880 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 18:04:50.268880 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 18:04:50.268880 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 18:04:50.268880 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 18:04:50.268880 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 18:04:50.268880 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 18:04:50.268880 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 18:04:50.268880 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 18:04:50.268880 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 18:04:50.268880 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 18:04:50.268880 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 18:04:50.268880 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 18:04:50.268880 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 18:04:50.268880 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 18:04:50.270346 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 18:04:50.270346 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 18:04:50.270346 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 18:04:50.270346 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 18:04:50.270346 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 901e4d7b-8262-43cb-a0c8-fa0e73f13bcc could not be found. Jul 14 18:04:50.270346 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.270346 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:04:50.270346 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.270346 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:04:50.270346 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:04:50.270346 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:04:50.270346 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:04:50.270346 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:04:50.270346 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 18:04:50.270346 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 18:04:50.270346 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:04:50.270346 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:04:50.270346 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 18:04:50.270346 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 18:04:50.271674 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 901e4d7b-8262-43cb-a0c8-fa0e73f13bcc could not be found. Jul 14 18:04:50.271674 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.271674 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:04:50.271674 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.271674 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:04:50.271674 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:04:50.271674 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:04:50.271674 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 18:04:50.271674 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 18:04:50.271674 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 901e4d7b-8262-43cb-a0c8-fa0e73f13bcc could not be found. Jul 14 18:04:50.271674 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.271674 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-d64b43bc-8870-45b8-b157-c5a052ca4236 tempest-VolumesNegativeTest-1572680148 tempest-VolumesNegativeTest-1572680148-project] Returning 404 to user: Volume 901e4d7b-8262-43cb-a0c8-fa0e73f13bcc could not be found. {{(pid=129471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:04:50.271674 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-d64b43bc-8870-45b8-b157-c5a052ca4236 tempest-VolumesNegativeTest-1572680148 tempest-VolumesNegativeTest-1572680148-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/901e4d7b-8262-43cb-a0c8-fa0e73f13bcc" status: 404 len: 109 microversion: 2.1 time: 0.037343 Jul 14 18:04:50.271674 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 581/1120] 10.222.0.64 () {58 vars in 1247 bytes} [Thu Jul 14 18:04:50 2022] DELETE /compute/v2.1/os-volumes/901e4d7b-8262-43cb-a0c8-fa0e73f13bcc => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 18:04:50.279082 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-45d31507-4f4b-4932-99bc-e2d5b8ccca23 tempest-VolumesNegativeTest-1572680148 tempest-VolumesNegativeTest-1572680148-project] Calling method '.version_select at 0x7f138021aca0>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:04:50.312805 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.wsgi [None req-45d31507-4f4b-4932-99bc-e2d5b8ccca23 tempest-VolumesNegativeTest-1572680148 tempest-VolumesNegativeTest-1572680148-project] HTTP exception thrown: Volume a036b961-adc6-4580-9f1e-27a5e3ef3cdf could not be found. Jul 14 18:04:50.314797 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-45d31507-4f4b-4932-99bc-e2d5b8ccca23 tempest-VolumesNegativeTest-1572680148 tempest-VolumesNegativeTest-1572680148-project] Request method failure captured: Jul 14 18:04:50.314797 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: request: GET /compute/v2.1/os-volumes/a036b961-adc6-4580-9f1e-27a5e3ef3cdf HTTP/1.1 Jul 14 18:04:50.314797 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept: application/json Jul 14 18:04:50.314797 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept-Encoding: identity Jul 14 18:04:50.314797 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Connection: close Jul 14 18:04:50.314797 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Length: 0 Jul 14 18:04:50.314797 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Type: application/json Jul 14 18:04:50.314797 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Host: 10.222.0.64 Jul 14 18:04:50.314797 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Openstack-System-Scope: None Jul 14 18:04:50.314797 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: User-Agent: python-urllib3/1.26.9 Jul 14 18:04:50.314797 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Auth-Token: gAAAAABi0FrB2Apwjb1ZRuN_QBHANsIlq-GKGY_JKiPTRuyn8boPlnFmF4hhH5JkJ_kJuDHDtODHyVNwUilMH2NDEF9p-ITnPbvxTdvTFdZ5EuPclMoBjRBw2JWZmCqhOAhsnd8PXr6PwoCTkNKmHFUuPfRRCOi23HX7ukjyFqepsAK193e8LWQ Jul 14 18:04:50.314797 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Id: None Jul 14 18:04:50.314797 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Name: None Jul 14 18:04:50.314797 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Identity-Status: Confirmed Jul 14 18:04:50.314797 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Is-Admin-Project: True Jul 14 18:04:50.314797 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Id: default Jul 14 18:04:50.314797 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Name: Default Jul 14 18:04:50.314797 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Id: 94b41787eebf4dc68871f38ff4ba12a8 Jul 14 18:04:50.314797 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Name: tempest-VolumesNegativeTest-1572680148 Jul 14 18:04:50.314797 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Role: reader,member Jul 14 18:04:50.314797 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Roles: reader,member Jul 14 18:04:50.316523 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/94b41787eebf4dc68871f38ff4ba12a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/94b41787eebf4dc68871f38ff4ba12a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/94b41787eebf4dc68871f38ff4ba12a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_94b41787eebf4dc68871f38ff4ba12a8", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:04:50.316523 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant: tempest-VolumesNegativeTest-1572680148 Jul 14 18:04:50.316523 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Id: 94b41787eebf4dc68871f38ff4ba12a8 Jul 14 18:04:50.316523 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Name: tempest-VolumesNegativeTest-1572680148 Jul 14 18:04:50.316523 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User: tempest-VolumesNegativeTest-1572680148-project Jul 14 18:04:50.316523 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Id: default Jul 14 18:04:50.316523 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Name: Default Jul 14 18:04:50.316523 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Id: c638a5ecc911478eaeb64aedd8d4c656 Jul 14 18:04:50.316523 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Name: tempest-VolumesNegativeTest-1572680148-project Jul 14 18:04:50.316523 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: method: Jul 14 18:04:50.316523 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: exception: Volume a036b961-adc6-4580-9f1e-27a5e3ef3cdf could not be found. Jul 14 18:04:50.316523 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: action_args: {'id': 'a036b961-adc6-4580-9f1e-27a5e3ef3cdf'} Jul 14 18:04:50.316523 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:04:50.317438 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:04:50.317438 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 18:04:50.317438 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 18:04:50.317438 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 18:04:50.317438 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 18:04:50.317438 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 18:04:50.317438 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 18:04:50.317438 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 18:04:50.317438 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 18:04:50.317438 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 18:04:50.317438 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 18:04:50.317438 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 18:04:50.317438 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 18:04:50.317438 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 18:04:50.317438 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 18:04:50.317438 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a036b961-adc6-4580-9f1e-27a5e3ef3cdf could not be found. (HTTP 404) (Request-ID: req-9402fa8b-218a-4aa6-8edb-c484d3c5fbd4) Jul 14 18:04:50.317438 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.317438 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:04:50.317438 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.318857 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:04:50.318857 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 18:04:50.318857 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 18:04:50.318857 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 18:04:50.318857 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 18:04:50.318857 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 18:04:50.318857 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 18:04:50.318857 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 18:04:50.318857 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 18:04:50.318857 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 18:04:50.318857 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 18:04:50.318857 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 18:04:50.318857 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 18:04:50.318857 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 18:04:50.318857 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 18:04:50.318857 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 18:04:50.318857 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 18:04:50.318857 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 18:04:50.318857 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 18:04:50.320697 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 18:04:50.320697 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 18:04:50.320697 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 18:04:50.320697 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 18:04:50.320697 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a036b961-adc6-4580-9f1e-27a5e3ef3cdf could not be found. Jul 14 18:04:50.320697 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.320697 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:04:50.320697 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.320697 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:04:50.320697 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:04:50.320697 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:04:50.320697 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:04:50.320697 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:04:50.320697 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 18:04:50.320697 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 18:04:50.320697 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:04:50.320697 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:04:50.320697 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 18:04:50.320697 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 18:04:50.322088 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a036b961-adc6-4580-9f1e-27a5e3ef3cdf could not be found. Jul 14 18:04:50.322088 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.322088 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:04:50.322088 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.322088 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:04:50.322088 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:04:50.322088 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:04:50.322088 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 18:04:50.322088 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 18:04:50.322088 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a036b961-adc6-4580-9f1e-27a5e3ef3cdf could not be found. Jul 14 18:04:50.322088 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:04:50.322088 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-45d31507-4f4b-4932-99bc-e2d5b8ccca23 tempest-VolumesNegativeTest-1572680148 tempest-VolumesNegativeTest-1572680148-project] Returning 404 to user: Volume a036b961-adc6-4580-9f1e-27a5e3ef3cdf could not be found. {{(pid=129470) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:04:50.322088 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-45d31507-4f4b-4932-99bc-e2d5b8ccca23 tempest-VolumesNegativeTest-1572680148 tempest-VolumesNegativeTest-1572680148-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/a036b961-adc6-4580-9f1e-27a5e3ef3cdf" status: 404 len: 109 microversion: 2.1 time: 0.041173 Jul 14 18:04:50.322088 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 540/1121] 10.222.0.64 () {58 vars in 1244 bytes} [Thu Jul 14 18:04:50 2022] GET /compute/v2.1/os-volumes/a036b961-adc6-4580-9f1e-27a5e3ef3cdf => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 18:05:50.090935 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:50.091728 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:50.096872 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-e07d958f-5b3a-4a49-a0e9-eeab2f6e70bf tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:05:50.097446 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-e07d958f-5b3a-4a49-a0e9-eeab2f6e70bf tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 939413a2-1f95-42f5-ad28-5fd1470b709f] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:05:50.105599 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e07d958f-5b3a-4a49-a0e9-eeab2f6e70bf tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:05:50.106619 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e07d958f-5b3a-4a49-a0e9-eeab2f6e70bf tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:05:50.107467 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e07d958f-5b3a-4a49-a0e9-eeab2f6e70bf tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:05:50.107912 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e07d958f-5b3a-4a49-a0e9-eeab2f6e70bf tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:05:50.135286 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-e07d958f-5b3a-4a49-a0e9-eeab2f6e70bf tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f/ips" status: 200 len: 149 microversion: 2.1 time: 0.046338 Jul 14 18:05:50.135891 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 582/1122] 10.222.0.64 () {58 vars in 1247 bytes} [Thu Jul 14 18:05:50 2022] GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f/ips => generated 149 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:05:51.729819 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:51.730720 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=30 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:51.736913 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-3ec83577-0b3c-4acf-91a3-61e3284ae43c tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c21e902-855b-48ca-aa86-a9bf28fccabe"}} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:05:51.738143 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-3ec83577-0b3c-4acf-91a3-61e3284ae43c tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 939413a2-1f95-42f5-ad28-5fd1470b709f] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:05:51.746654 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3ec83577-0b3c-4acf-91a3-61e3284ae43c tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:05:51.747112 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3ec83577-0b3c-4acf-91a3-61e3284ae43c tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:05:51.747947 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3ec83577-0b3c-4acf-91a3-61e3284ae43c tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:05:51.748398 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3ec83577-0b3c-4acf-91a3-61e3284ae43c tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:05:52.071459 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-3ec83577-0b3c-4acf-91a3-61e3284ae43c tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "POST /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.343723 Jul 14 18:05:52.072143 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 541/1123] 10.222.0.64 () {60 vars in 1322 bytes} [Thu Jul 14 18:05:51 2022] POST /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f/os-volume_attachments => generated 194 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:05:59.659519 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-614752b6-ec73-4ae7-92d7-adfbdf752b78 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Action: 'create', calling method: .version_select at 0x7f138007fca0>, body: {"keypair": {"name": "tempest-keypair-908342956", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4GumZJ6c7l4LyshurUubHnYcVrhnzyvyuqQPr/cp7EW6o2nEtlv/aG0Vl07tUN3+u9/SYGiUMg6+kbBvZdKEd7C/XPF81UPrIPlmxssrzkIzrz5QATcwvc4+Ohjw5mDA=="}} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:05:59.677110 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.quota [None req-614752b6-ec73-4ae7-92d7-adfbdf752b78 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Getting quotas for project cd7b0d70fffe4d37a84bd4ee73d044ca. Resources: {'key_pairs'} {{(pid=129471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 18:05:59.681871 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.quota [None req-614752b6-ec73-4ae7-92d7-adfbdf752b78 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Getting quotas for user d1a7b2376e83489b87feb4b9fd449d55 and project cd7b0d70fffe4d37a84bd4ee73d044ca. Resources: {'key_pairs'} {{(pid=129471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 18:05:59.711316 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-614752b6-ec73-4ae7-92d7-adfbdf752b78 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055914 Jul 14 18:05:59.712084 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 583/1124] 10.222.0.64 () {60 vars in 1158 bytes} [Thu Jul 14 18:05:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 18:06:01.527595 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-47aa06c3-d047-4d2a-96a7-31d08765486a tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1723377471", "imageRef": "cf1f5d8c-9e49-4272-8e19-8e3c587056e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d836dc14-adcd-46d4-983c-5e81fdb4ff39"}], "security_groups": [{"name": "tempest-securitygroup--1964305235"}], "key_name": "tempest-keypair-908342956", "user_data": "}} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:06:01.643614 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.network.neutron [None req-47aa06c3-d047-4d2a-96a7-31d08765486a tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] validate_networks() for [('d836dc14-adcd-46d4-983c-5e81fdb4ff39', None, None, None, None, None)] {{(pid=129470) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 18:06:02.061707 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:06:02.098189 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-47aa06c3-d047-4d2a-96a7-31d08765486a tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Flavor limits 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 18:06:02.098661 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-47aa06c3-d047-4d2a-96a7-31d08765486a tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Image limits 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 18:06:02.099305 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-47aa06c3-d047-4d2a-96a7-31d08765486a tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Flavor pref 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 18:06:02.099845 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-47aa06c3-d047-4d2a-96a7-31d08765486a tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Image pref 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 18:06:02.100409 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-47aa06c3-d047-4d2a-96a7-31d08765486a tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 18:06:02.111918 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-47aa06c3-d047-4d2a-96a7-31d08765486a tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:06:02.112586 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-47aa06c3-d047-4d2a-96a7-31d08765486a tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:06:02.113498 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-47aa06c3-d047-4d2a-96a7-31d08765486a tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:06:02.114038 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-47aa06c3-d047-4d2a-96a7-31d08765486a tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:06:02.136670 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.quota [None req-47aa06c3-d047-4d2a-96a7-31d08765486a tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Getting quotas for project cd7b0d70fffe4d37a84bd4ee73d044ca. Resources: {'ram', 'cores', 'instances'} {{(pid=129470) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 18:06:02.141136 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.quota [None req-47aa06c3-d047-4d2a-96a7-31d08765486a tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Getting quotas for user d1a7b2376e83489b87feb4b9fd449d55 and project cd7b0d70fffe4d37a84bd4ee73d044ca. Resources: {'ram', 'cores', 'instances'} {{(pid=129470) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 18:06:02.154571 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-47aa06c3-d047-4d2a-96a7-31d08765486a tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Going to run 1 instances... {{(pid=129470) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 18:06:02.157074 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-47aa06c3-d047-4d2a-96a7-31d08765486a tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 9947ad7c-1b7a-4db5-8968-94691c54575a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf1f5d8c-9e49-4272-8e19-8e3c587056e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129470) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 18:06:02.222983 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-47aa06c3-d047-4d2a-96a7-31d08765486a tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.701073 Jul 14 18:06:02.224392 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 542/1125] 10.222.0.64 () {60 vars in 1146 bytes} [Thu Jul 14 18:06:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 18:06:02.234283 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=4 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:06:02.244384 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-375c434a-0bfa-4924-be7f-b9e717ecae1d tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:06:02.245221 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-375c434a-0bfa-4924-be7f-b9e717ecae1d tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 9947ad7c-1b7a-4db5-8968-94691c54575a] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:06:02.316204 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-375c434a-0bfa-4924-be7f-b9e717ecae1d tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:06:02.329363 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-375c434a-0bfa-4924-be7f-b9e717ecae1d tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a" status: 200 len: 1241 microversion: 2.1 time: 0.095202 Jul 14 18:06:02.330363 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 584/1126] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:06:02 2022] GET /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a => generated 1241 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:06:03.348477 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-c3fc3e85-b705-422d-bd81-579c458efcd1 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:06:03.349167 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-c3fc3e85-b705-422d-bd81-579c458efcd1 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 9947ad7c-1b7a-4db5-8968-94691c54575a] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:06:03.357875 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c3fc3e85-b705-422d-bd81-579c458efcd1 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:06:03.358363 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c3fc3e85-b705-422d-bd81-579c458efcd1 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:06:03.359159 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c3fc3e85-b705-422d-bd81-579c458efcd1 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:06:03.359606 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-c3fc3e85-b705-422d-bd81-579c458efcd1 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:06:03.431157 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-c3fc3e85-b705-422d-bd81-579c458efcd1 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:06:03.440652 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-c3fc3e85-b705-422d-bd81-579c458efcd1 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a" status: 200 len: 1293 microversion: 2.1 time: 0.096782 Jul 14 18:06:03.441286 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 543/1127] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:06:03 2022] GET /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a => generated 1293 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 18:06:04.469886 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-c2511c68-7982-4a84-a3ed-96b9a1af3919 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:06:04.471410 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-c2511c68-7982-4a84-a3ed-96b9a1af3919 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 9947ad7c-1b7a-4db5-8968-94691c54575a] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:06:04.482353 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c2511c68-7982-4a84-a3ed-96b9a1af3919 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:06:04.483112 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c2511c68-7982-4a84-a3ed-96b9a1af3919 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:06:04.484271 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c2511c68-7982-4a84-a3ed-96b9a1af3919 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:06:04.485269 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c2511c68-7982-4a84-a3ed-96b9a1af3919 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:06:04.686208 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-c2511c68-7982-4a84-a3ed-96b9a1af3919 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:06:04.698629 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-c2511c68-7982-4a84-a3ed-96b9a1af3919 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a" status: 200 len: 1367 microversion: 2.1 time: 0.234514 Jul 14 18:06:04.701365 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 585/1128] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:06:04 2022] GET /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:06:05.497111 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-6b91269d-e5d5-4f19-b5e6-27e3d069a63d req-02ed48c0-be06-4066-97e3-68432e740f78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9947ad7c-1b7a-4db5-8968-94691c54575a", "tag": "1ac2d42f-f5ef-4d2a-9386-7e31c4fa266e"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:06:05.513987 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-6b91269d-e5d5-4f19-b5e6-27e3d069a63d req-02ed48c0-be06-4066-97e3-68432e740f78 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:06:05.514472 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-6b91269d-e5d5-4f19-b5e6-27e3d069a63d req-02ed48c0-be06-4066-97e3-68432e740f78 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:06:05.527018 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-6b91269d-e5d5-4f19-b5e6-27e3d069a63d req-02ed48c0-be06-4066-97e3-68432e740f78 service nova] Creating event network-changed:1ac2d42f-f5ef-4d2a-9386-7e31c4fa266e for instance 9947ad7c-1b7a-4db5-8968-94691c54575a on hv-cinder-84989 Jul 14 18:06:05.533049 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-6b91269d-e5d5-4f19-b5e6-27e3d069a63d req-02ed48c0-be06-4066-97e3-68432e740f78 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043362 Jul 14 18:06:05.533635 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 544/1129] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:06:05.719500 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-ff453e11-7830-4fde-afd0-948f6621b2ea tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:06:05.720603 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-ff453e11-7830-4fde-afd0-948f6621b2ea tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 9947ad7c-1b7a-4db5-8968-94691c54575a] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:06:05.729614 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ff453e11-7830-4fde-afd0-948f6621b2ea tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:06:05.730376 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ff453e11-7830-4fde-afd0-948f6621b2ea tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:06:05.731464 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ff453e11-7830-4fde-afd0-948f6621b2ea tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:06:05.732167 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-ff453e11-7830-4fde-afd0-948f6621b2ea tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:06:05.919110 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-ff453e11-7830-4fde-afd0-948f6621b2ea tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:06:05.933213 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-ff453e11-7830-4fde-afd0-948f6621b2ea tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a" status: 200 len: 1367 microversion: 2.1 time: 0.218184 Jul 14 18:06:05.934457 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 586/1130] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:06:05 2022] GET /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:06:06.953618 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-f2a25ad3-3b9c-4eb6-9598-b0d6002f36bc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:06:06.954311 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-f2a25ad3-3b9c-4eb6-9598-b0d6002f36bc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 9947ad7c-1b7a-4db5-8968-94691c54575a] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:06:06.960676 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f2a25ad3-3b9c-4eb6-9598-b0d6002f36bc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:06:06.961131 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f2a25ad3-3b9c-4eb6-9598-b0d6002f36bc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:06:06.961913 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f2a25ad3-3b9c-4eb6-9598-b0d6002f36bc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:06:06.962358 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f2a25ad3-3b9c-4eb6-9598-b0d6002f36bc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:06:07.112229 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-f2a25ad3-3b9c-4eb6-9598-b0d6002f36bc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:06:07.132913 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-f2a25ad3-3b9c-4eb6-9598-b0d6002f36bc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a" status: 200 len: 1367 microversion: 2.1 time: 0.181410 Jul 14 18:06:07.135373 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 545/1131] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:06:06 2022] GET /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 18:06:08.156216 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-92fea190-0df3-4fdf-ab2c-179a0f2e3bca tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:06:08.156900 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-92fea190-0df3-4fdf-ab2c-179a0f2e3bca tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 9947ad7c-1b7a-4db5-8968-94691c54575a] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:06:08.163969 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-92fea190-0df3-4fdf-ab2c-179a0f2e3bca tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:06:08.164592 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-92fea190-0df3-4fdf-ab2c-179a0f2e3bca tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:06:08.166066 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-92fea190-0df3-4fdf-ab2c-179a0f2e3bca tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:06:08.166506 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-92fea190-0df3-4fdf-ab2c-179a0f2e3bca tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:06:08.305802 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-92fea190-0df3-4fdf-ab2c-179a0f2e3bca tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:06:08.315434 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-92fea190-0df3-4fdf-ab2c-179a0f2e3bca tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a" status: 200 len: 1367 microversion: 2.1 time: 0.166383 Jul 14 18:06:08.316049 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 587/1132] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:06:08 2022] GET /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:06:09.332738 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-fd7a69e0-4efa-45b4-b873-7cc0c1086b5b tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:06:09.333384 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-fd7a69e0-4efa-45b4-b873-7cc0c1086b5b tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 9947ad7c-1b7a-4db5-8968-94691c54575a] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:06:09.341244 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fd7a69e0-4efa-45b4-b873-7cc0c1086b5b tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:06:09.341701 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fd7a69e0-4efa-45b4-b873-7cc0c1086b5b tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:06:09.342503 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fd7a69e0-4efa-45b4-b873-7cc0c1086b5b tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:06:09.342951 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fd7a69e0-4efa-45b4-b873-7cc0c1086b5b tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:06:09.491264 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-fd7a69e0-4efa-45b4-b873-7cc0c1086b5b tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:06:09.499548 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-fd7a69e0-4efa-45b4-b873-7cc0c1086b5b tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a" status: 200 len: 1367 microversion: 2.1 time: 0.170671 Jul 14 18:06:09.500169 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 546/1133] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:06:09 2022] GET /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:06:10.516749 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-5696d969-b8bd-4e47-a3eb-c5238fb6cec7 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:06:10.517366 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-5696d969-b8bd-4e47-a3eb-c5238fb6cec7 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 9947ad7c-1b7a-4db5-8968-94691c54575a] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:06:10.524209 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5696d969-b8bd-4e47-a3eb-c5238fb6cec7 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:06:10.525300 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5696d969-b8bd-4e47-a3eb-c5238fb6cec7 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:06:10.526105 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5696d969-b8bd-4e47-a3eb-c5238fb6cec7 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:06:10.526543 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5696d969-b8bd-4e47-a3eb-c5238fb6cec7 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:06:10.674079 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-5696d969-b8bd-4e47-a3eb-c5238fb6cec7 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:06:10.682924 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-5696d969-b8bd-4e47-a3eb-c5238fb6cec7 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a" status: 200 len: 1367 microversion: 2.1 time: 0.169838 Jul 14 18:06:10.683589 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 588/1134] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:06:10 2022] GET /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:06:11.172967 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-ac92e678-300d-4268-a997-c362319a0a12 req-cdd81baa-ad84-4e3c-a5b3-eebd1d9aaac4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9947ad7c-1b7a-4db5-8968-94691c54575a", "name": "network-vif-plugged", "status": "completed", "tag": "1ac2d42f-f5ef-4d2a-9386-7e31c4fa266e"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:06:11.189418 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-ac92e678-300d-4268-a997-c362319a0a12 req-cdd81baa-ad84-4e3c-a5b3-eebd1d9aaac4 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:06:11.190209 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-ac92e678-300d-4268-a997-c362319a0a12 req-cdd81baa-ad84-4e3c-a5b3-eebd1d9aaac4 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:06:11.215077 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-ac92e678-300d-4268-a997-c362319a0a12 req-cdd81baa-ad84-4e3c-a5b3-eebd1d9aaac4 service nova] Creating event network-vif-plugged:1ac2d42f-f5ef-4d2a-9386-7e31c4fa266e for instance 9947ad7c-1b7a-4db5-8968-94691c54575a on hv-cinder-84989 Jul 14 18:06:11.224722 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-ac92e678-300d-4268-a997-c362319a0a12 req-cdd81baa-ad84-4e3c-a5b3-eebd1d9aaac4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055929 Jul 14 18:06:11.225859 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 547/1135] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:06:11.700824 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-239f1ac7-d052-4f24-b2db-063576722f4e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:06:11.701617 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-239f1ac7-d052-4f24-b2db-063576722f4e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 9947ad7c-1b7a-4db5-8968-94691c54575a] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:06:11.708728 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-239f1ac7-d052-4f24-b2db-063576722f4e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:06:11.709225 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-239f1ac7-d052-4f24-b2db-063576722f4e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:06:11.710056 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-239f1ac7-d052-4f24-b2db-063576722f4e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:06:11.710650 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-239f1ac7-d052-4f24-b2db-063576722f4e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:06:11.854401 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-239f1ac7-d052-4f24-b2db-063576722f4e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:06:11.862541 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-239f1ac7-d052-4f24-b2db-063576722f4e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a" status: 200 len: 1367 microversion: 2.1 time: 0.165610 Jul 14 18:06:11.863147 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 589/1136] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:06:11 2022] GET /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:06:12.876966 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell0:SELECT=2 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:06:12.877756 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell0:SELECT=6 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:06:12.882869 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-492ed984-5908-4498-913e-1aff2517a776 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:06:12.884111 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-492ed984-5908-4498-913e-1aff2517a776 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 9947ad7c-1b7a-4db5-8968-94691c54575a] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:06:12.891749 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-492ed984-5908-4498-913e-1aff2517a776 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:06:12.892257 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-492ed984-5908-4498-913e-1aff2517a776 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:06:12.893052 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-492ed984-5908-4498-913e-1aff2517a776 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:06:12.893499 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-492ed984-5908-4498-913e-1aff2517a776 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:06:13.043051 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-492ed984-5908-4498-913e-1aff2517a776 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:06:13.051164 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-492ed984-5908-4498-913e-1aff2517a776 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a" status: 200 len: 1367 microversion: 2.1 time: 0.175059 Jul 14 18:06:13.051756 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 548/1137] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:06:12 2022] GET /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:06:14.078038 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-5bf21d01-8dd0-4f4d-a6af-6b04f84129be tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:06:14.078649 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-5bf21d01-8dd0-4f4d-a6af-6b04f84129be tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 9947ad7c-1b7a-4db5-8968-94691c54575a] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:06:14.080699 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell0:SELECT=6 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:06:14.088322 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5bf21d01-8dd0-4f4d-a6af-6b04f84129be tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:06:14.088774 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5bf21d01-8dd0-4f4d-a6af-6b04f84129be tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:06:14.089577 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5bf21d01-8dd0-4f4d-a6af-6b04f84129be tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:06:14.090018 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5bf21d01-8dd0-4f4d-a6af-6b04f84129be tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:06:14.273311 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-5bf21d01-8dd0-4f4d-a6af-6b04f84129be tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:06:14.287649 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-5bf21d01-8dd0-4f4d-a6af-6b04f84129be tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a" status: 200 len: 1557 microversion: 2.1 time: 0.213186 Jul 14 18:06:14.288686 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 590/1138] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:06:14 2022] GET /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a => generated 1557 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:06:14.305486 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-d304300a-ddd7-4503-a335-3731f747be23 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:06:14.306200 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-d304300a-ddd7-4503-a335-3731f747be23 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 9947ad7c-1b7a-4db5-8968-94691c54575a] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:06:14.313342 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d304300a-ddd7-4503-a335-3731f747be23 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:06:14.313803 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d304300a-ddd7-4503-a335-3731f747be23 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:06:14.314627 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d304300a-ddd7-4503-a335-3731f747be23 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:06:14.315068 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d304300a-ddd7-4503-a335-3731f747be23 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:06:14.400687 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-d304300a-ddd7-4503-a335-3731f747be23 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099227 Jul 14 18:06:14.401295 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 549/1139] 10.222.0.64 () {58 vars in 1274 bytes} [Thu Jul 14 18:06:14 2022] GET /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:06:15.878957 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [req-bd09a23b-87e0-4845-bd1f-b947a47dbd72 req-e98bbdab-1b89-464b-906e-fe589e8539a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9947ad7c-1b7a-4db5-8968-94691c54575a", "tag": "1ac2d42f-f5ef-4d2a-9386-7e31c4fa266e"}]} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:06:15.888015 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-bd09a23b-87e0-4845-bd1f-b947a47dbd72 req-e98bbdab-1b89-464b-906e-fe589e8539a9 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:06:15.888464 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-bd09a23b-87e0-4845-bd1f-b947a47dbd72 req-e98bbdab-1b89-464b-906e-fe589e8539a9 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:06:15.901474 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.compute.server_external_events [req-bd09a23b-87e0-4845-bd1f-b947a47dbd72 req-e98bbdab-1b89-464b-906e-fe589e8539a9 service nova] Creating event network-changed:1ac2d42f-f5ef-4d2a-9386-7e31c4fa266e for instance 9947ad7c-1b7a-4db5-8968-94691c54575a on hv-cinder-84989 Jul 14 18:06:15.906853 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [req-bd09a23b-87e0-4845-bd1f-b947a47dbd72 req-e98bbdab-1b89-464b-906e-fe589e8539a9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164219 Jul 14 18:06:15.907479 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 591/1140] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:07:03.655290 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 18:07:03.656041 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Thu Jul 14 18:07:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 18:07:08.839452 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 18:07:08.840083 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Thu Jul 14 18:07:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 18:07:31.093060 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:07:31.093833 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=34 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:07:31.098308 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-b5176b75-b800-4c31-9e4f-c672921f4f0e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:07:31.098811 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-b5176b75-b800-4c31-9e4f-c672921f4f0e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 9947ad7c-1b7a-4db5-8968-94691c54575a] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:07:31.106572 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b5176b75-b800-4c31-9e4f-c672921f4f0e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:31.107026 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b5176b75-b800-4c31-9e4f-c672921f4f0e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:31.107807 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b5176b75-b800-4c31-9e4f-c672921f4f0e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:31.108275 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b5176b75-b800-4c31-9e4f-c672921f4f0e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:31.132068 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-b5176b75-b800-4c31-9e4f-c672921f4f0e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a/ips" status: 200 len: 149 microversion: 2.1 time: 0.040960 Jul 14 18:07:31.132645 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 550/1141] 10.222.0.64 () {58 vars in 1247 bytes} [Thu Jul 14 18:07:31 2022] GET /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:07:31.142030 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:07:31.142860 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=38 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:07:31.147995 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-7ba70619-0fb7-4ef9-9a1d-e4d118aa8e8f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c21e902-855b-48ca-aa86-a9bf28fccabe"}} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:07:31.149131 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-7ba70619-0fb7-4ef9-9a1d-e4d118aa8e8f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 9947ad7c-1b7a-4db5-8968-94691c54575a] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:07:31.156495 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7ba70619-0fb7-4ef9-9a1d-e4d118aa8e8f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:31.156940 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7ba70619-0fb7-4ef9-9a1d-e4d118aa8e8f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:31.157696 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7ba70619-0fb7-4ef9-9a1d-e4d118aa8e8f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:31.158130 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7ba70619-0fb7-4ef9-9a1d-e4d118aa8e8f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:31.335426 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.wsgi [None req-7ba70619-0fb7-4ef9-9a1d-e4d118aa8e8f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] HTTP exception thrown: Invalid volume: volume 6c21e902-855b-48ca-aa86-a9bf28fccabe is already attached to instances: 939413a2-1f95-42f5-ad28-5fd1470b709f Jul 14 18:07:31.337172 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-7ba70619-0fb7-4ef9-9a1d-e4d118aa8e8f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Request method failure captured: Jul 14 18:07:31.337172 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: request: POST /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a/os-volume_attachments HTTP/1.1 Jul 14 18:07:31.337172 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept: application/json Jul 14 18:07:31.337172 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept-Encoding: identity Jul 14 18:07:31.337172 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Connection: close Jul 14 18:07:31.337172 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Length: 74 Jul 14 18:07:31.337172 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Type: application/json Jul 14 18:07:31.337172 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Host: 10.222.0.64 Jul 14 18:07:31.337172 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Openstack-System-Scope: None Jul 14 18:07:31.337172 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: User-Agent: python-urllib3/1.26.9 Jul 14 18:07:31.337172 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Auth-Token: gAAAAABi0FqQJwSdeIlyvTJTebGB2HswWMQXdEeVQ1nqnsr0mN7imW5yYBtB7v0AYBUvhZx3ERaakjDBC-y17nbWzPHdLShTJjvjoOWOEu2O2dHU4WvbtqYTFlYdN2M2cROj3RwdhDe-fwWgM_ya_OxtW44tU56VzqdTH9IrVrscBvrZes_8UeI Jul 14 18:07:31.337172 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Id: None Jul 14 18:07:31.337172 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Name: None Jul 14 18:07:31.337172 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Identity-Status: Confirmed Jul 14 18:07:31.337172 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Is-Admin-Project: True Jul 14 18:07:31.337172 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Id: default Jul 14 18:07:31.337172 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Name: Default Jul 14 18:07:31.337172 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Id: cd7b0d70fffe4d37a84bd4ee73d044ca Jul 14 18:07:31.337172 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Name: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:07:31.337172 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Role: reader,member Jul 14 18:07:31.337172 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Roles: reader,member Jul 14 18:07:31.339022 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cd7b0d70fffe4d37a84bd4ee73d044ca", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:07:31.339022 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:07:31.339022 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Id: cd7b0d70fffe4d37a84bd4ee73d044ca Jul 14 18:07:31.339022 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:07:31.339022 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User: tempest-AttachVolumeNegativeTest-775141180-project Jul 14 18:07:31.339022 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Id: default Jul 14 18:07:31.339022 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Name: Default Jul 14 18:07:31.339022 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Id: d1a7b2376e83489b87feb4b9fd449d55 Jul 14 18:07:31.339022 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Name: tempest-AttachVolumeNegativeTest-775141180-project Jul 14 18:07:31.339022 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Jul 14 18:07:31.339022 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: {"volumeAttachment": {"volumeId": "6c21e902-855b-48ca-aa86-a9bf28fccabe"}} Jul 14 18:07:31.339022 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: method: > Jul 14 18:07:31.340116 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: exception: Invalid volume: volume 6c21e902-855b-48ca-aa86-a9bf28fccabe is already attached to instances: 939413a2-1f95-42f5-ad28-5fd1470b709f Jul 14 18:07:31.340116 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: action_args: {'server_id': '9947ad7c-1b7a-4db5-8968-94691c54575a', 'body': {'volumeAttachment': {'volumeId': '6c21e902-855b-48ca-aa86-a9bf28fccabe'}}} Jul 14 18:07:31.340116 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:07:31.340116 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:07:31.340116 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 18:07:31.340116 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 18:07:31.340116 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 18:07:31.340116 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 18:07:31.340116 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 18:07:31.340116 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 18:07:31.340116 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 14 18:07:31.340116 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 14 18:07:31.340116 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 14 18:07:31.340116 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 14 18:07:31.340116 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6c21e902-855b-48ca-aa86-a9bf28fccabe is already attached to instances: 939413a2-1f95-42f5-ad28-5fd1470b709f Jul 14 18:07:31.340116 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:07:31.340116 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:07:31.340116 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:07:31.340116 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:07:31.341717 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:07:31.341717 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:07:31.341717 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:07:31.341717 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:07:31.341717 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:07:31.341717 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:07:31.341717 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 18:07:31.341717 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 18:07:31.341717 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 18:07:31.341717 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 18:07:31.341717 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 18:07:31.341717 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 18:07:31.341717 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 14 18:07:31.341717 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 18:07:31.341717 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6c21e902-855b-48ca-aa86-a9bf28fccabe is already attached to instances: 939413a2-1f95-42f5-ad28-5fd1470b709f Jul 14 18:07:31.341717 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:07:31.341717 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:07:31.341717 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:07:31.341717 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:07:31.341717 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:07:31.344210 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:07:31.344210 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 18:07:31.344210 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 18:07:31.344210 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6c21e902-855b-48ca-aa86-a9bf28fccabe is already attached to instances: 939413a2-1f95-42f5-ad28-5fd1470b709f Jul 14 18:07:31.344210 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:07:31.344210 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-7ba70619-0fb7-4ef9-9a1d-e4d118aa8e8f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Returning 400 to user: Invalid volume: volume 6c21e902-855b-48ca-aa86-a9bf28fccabe is already attached to instances: 939413a2-1f95-42f5-ad28-5fd1470b709f {{(pid=129471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:07:31.344210 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-7ba70619-0fb7-4ef9-9a1d-e4d118aa8e8f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "POST /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.198777 Jul 14 18:07:31.344210 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 592/1142] 10.222.0.64 () {60 vars in 1322 bytes} [Thu Jul 14 18:07:31 2022] POST /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a/os-volume_attachments => generated 174 bytes in 200 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 18:07:31.347414 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-e38909b8-124b-40e6-b291-ca64b6f096a3 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:07:31.347946 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-e38909b8-124b-40e6-b291-ca64b6f096a3 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 9947ad7c-1b7a-4db5-8968-94691c54575a] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:07:31.354252 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e38909b8-124b-40e6-b291-ca64b6f096a3 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:31.354704 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e38909b8-124b-40e6-b291-ca64b6f096a3 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:31.355474 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e38909b8-124b-40e6-b291-ca64b6f096a3 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:31.355919 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e38909b8-124b-40e6-b291-ca64b6f096a3 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:31.380532 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-e38909b8-124b-40e6-b291-ca64b6f096a3 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 9947ad7c-1b7a-4db5-8968-94691c54575a] Going to try to terminate instance {{(pid=129470) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 18:07:31.458201 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-e38909b8-124b-40e6-b291-ca64b6f096a3 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "DELETE /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a" status: 204 len: 0 microversion: 2.1 time: 0.114355 Jul 14 18:07:31.458796 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 551/1143] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Jul 14 18:07:31 2022] DELETE /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 18:07:31.470001 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-5eafd025-c31d-47cf-8f87-10503aa82c82 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:07:31.470697 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-5eafd025-c31d-47cf-8f87-10503aa82c82 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 9947ad7c-1b7a-4db5-8968-94691c54575a] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:07:31.480635 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5eafd025-c31d-47cf-8f87-10503aa82c82 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:31.481095 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5eafd025-c31d-47cf-8f87-10503aa82c82 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:31.481874 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5eafd025-c31d-47cf-8f87-10503aa82c82 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:31.482316 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5eafd025-c31d-47cf-8f87-10503aa82c82 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:31.611318 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-5eafd025-c31d-47cf-8f87-10503aa82c82 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:07:31.618928 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-5eafd025-c31d-47cf-8f87-10503aa82c82 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a" status: 200 len: 1681 microversion: 2.1 time: 0.154977 Jul 14 18:07:31.620092 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 593/1144] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:07:31 2022] GET /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 18:07:32.638132 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-29b20b4f-5dd9-46d5-ac4a-cdd3fd1976fc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:07:32.638752 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-29b20b4f-5dd9-46d5-ac4a-cdd3fd1976fc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 9947ad7c-1b7a-4db5-8968-94691c54575a] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:07:32.645272 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-29b20b4f-5dd9-46d5-ac4a-cdd3fd1976fc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:32.645724 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-29b20b4f-5dd9-46d5-ac4a-cdd3fd1976fc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:32.646495 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-29b20b4f-5dd9-46d5-ac4a-cdd3fd1976fc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:32.647074 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-29b20b4f-5dd9-46d5-ac4a-cdd3fd1976fc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:32.874551 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-29b20b4f-5dd9-46d5-ac4a-cdd3fd1976fc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:07:32.881946 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-29b20b4f-5dd9-46d5-ac4a-cdd3fd1976fc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a" status: 200 len: 1681 microversion: 2.1 time: 0.248819 Jul 14 18:07:32.882506 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 552/1145] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:07:32 2022] GET /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a => generated 1681 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:07:33.900833 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-7510e4dd-b038-4757-b539-fd900ba6cc52 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:07:33.901461 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-7510e4dd-b038-4757-b539-fd900ba6cc52 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 9947ad7c-1b7a-4db5-8968-94691c54575a] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:07:33.908172 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7510e4dd-b038-4757-b539-fd900ba6cc52 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:33.908633 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7510e4dd-b038-4757-b539-fd900ba6cc52 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:33.909411 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7510e4dd-b038-4757-b539-fd900ba6cc52 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:33.909850 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7510e4dd-b038-4757-b539-fd900ba6cc52 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:34.053254 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-7510e4dd-b038-4757-b539-fd900ba6cc52 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:07:34.060882 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-7510e4dd-b038-4757-b539-fd900ba6cc52 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a" status: 200 len: 1681 microversion: 2.1 time: 0.164535 Jul 14 18:07:34.061450 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 594/1146] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:07:33 2022] GET /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:07:34.435404 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-baa7732a-32ee-4d4f-b80a-f5892b309182 req-a35bcad5-ee2e-4dcd-b032-67b23960a9ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9947ad7c-1b7a-4db5-8968-94691c54575a", "name": "network-vif-deleted", "tag": "1ac2d42f-f5ef-4d2a-9386-7e31c4fa266e"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:07:34.445869 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-baa7732a-32ee-4d4f-b80a-f5892b309182 req-a35bcad5-ee2e-4dcd-b032-67b23960a9ec service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:34.446316 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-baa7732a-32ee-4d4f-b80a-f5892b309182 req-a35bcad5-ee2e-4dcd-b032-67b23960a9ec service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:34.460345 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-baa7732a-32ee-4d4f-b80a-f5892b309182 req-a35bcad5-ee2e-4dcd-b032-67b23960a9ec service nova] Creating event network-vif-deleted:1ac2d42f-f5ef-4d2a-9386-7e31c4fa266e for instance 9947ad7c-1b7a-4db5-8968-94691c54575a on hv-cinder-84989 Jul 14 18:07:34.466187 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-baa7732a-32ee-4d4f-b80a-f5892b309182 req-a35bcad5-ee2e-4dcd-b032-67b23960a9ec service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035171 Jul 14 18:07:34.468267 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 553/1147] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:07:35.078305 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-1b6b1caa-b2a0-4545-a661-2db691508334 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:07:35.079152 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-1b6b1caa-b2a0-4545-a661-2db691508334 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 9947ad7c-1b7a-4db5-8968-94691c54575a] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:07:35.085506 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1b6b1caa-b2a0-4545-a661-2db691508334 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:35.085966 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1b6b1caa-b2a0-4545-a661-2db691508334 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:35.086750 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1b6b1caa-b2a0-4545-a661-2db691508334 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:35.087197 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1b6b1caa-b2a0-4545-a661-2db691508334 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:35.102070 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.wsgi [None req-1b6b1caa-b2a0-4545-a661-2db691508334 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] HTTP exception thrown: Instance 9947ad7c-1b7a-4db5-8968-94691c54575a could not be found. Jul 14 18:07:35.104228 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-1b6b1caa-b2a0-4545-a661-2db691508334 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Request method failure captured: Jul 14 18:07:35.104228 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: request: GET /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a HTTP/1.1 Jul 14 18:07:35.104228 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept: application/json Jul 14 18:07:35.104228 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept-Encoding: identity Jul 14 18:07:35.104228 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Connection: close Jul 14 18:07:35.104228 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Length: 0 Jul 14 18:07:35.104228 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Type: application/json Jul 14 18:07:35.104228 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Host: 10.222.0.64 Jul 14 18:07:35.104228 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Openstack-System-Scope: None Jul 14 18:07:35.104228 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: User-Agent: python-urllib3/1.26.9 Jul 14 18:07:35.104228 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Auth-Token: gAAAAABi0FqQJwSdeIlyvTJTebGB2HswWMQXdEeVQ1nqnsr0mN7imW5yYBtB7v0AYBUvhZx3ERaakjDBC-y17nbWzPHdLShTJjvjoOWOEu2O2dHU4WvbtqYTFlYdN2M2cROj3RwdhDe-fwWgM_ya_OxtW44tU56VzqdTH9IrVrscBvrZes_8UeI Jul 14 18:07:35.104228 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Id: None Jul 14 18:07:35.104228 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Name: None Jul 14 18:07:35.104228 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Identity-Status: Confirmed Jul 14 18:07:35.104228 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Is-Admin-Project: True Jul 14 18:07:35.104228 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Id: default Jul 14 18:07:35.104228 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Name: Default Jul 14 18:07:35.104228 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Id: cd7b0d70fffe4d37a84bd4ee73d044ca Jul 14 18:07:35.104228 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Name: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:07:35.104228 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Role: reader,member Jul 14 18:07:35.104228 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Roles: reader,member Jul 14 18:07:35.106012 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cd7b0d70fffe4d37a84bd4ee73d044ca", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:07:35.106012 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:07:35.106012 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Id: cd7b0d70fffe4d37a84bd4ee73d044ca Jul 14 18:07:35.106012 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:07:35.106012 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User: tempest-AttachVolumeNegativeTest-775141180-project Jul 14 18:07:35.106012 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Id: default Jul 14 18:07:35.106012 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Name: Default Jul 14 18:07:35.106012 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Id: d1a7b2376e83489b87feb4b9fd449d55 Jul 14 18:07:35.106012 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Name: tempest-AttachVolumeNegativeTest-775141180-project Jul 14 18:07:35.106012 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: method: > Jul 14 18:07:35.106012 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: exception: Instance 9947ad7c-1b7a-4db5-8968-94691c54575a could not be found. Jul 14 18:07:35.106012 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: action_args: {'id': '9947ad7c-1b7a-4db5-8968-94691c54575a'} Jul 14 18:07:35.106863 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:07:35.106863 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:07:35.106863 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 18:07:35.106863 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 18:07:35.106863 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 18:07:35.106863 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 18:07:35.106863 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 18:07:35.106863 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 18:07:35.106863 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 18:07:35.106863 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 18:07:35.106863 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9947ad7c-1b7a-4db5-8968-94691c54575a could not be found. Jul 14 18:07:35.106863 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:07:35.106863 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:07:35.106863 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:07:35.106863 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:07:35.106863 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:07:35.106863 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:07:35.106863 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:07:35.106863 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:07:35.106863 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:07:35.108182 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:07:35.108182 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 18:07:35.108182 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 18:07:35.108182 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 18:07:35.108182 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 18:07:35.108182 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 18:07:35.108182 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 18:07:35.108182 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9947ad7c-1b7a-4db5-8968-94691c54575a could not be found. Jul 14 18:07:35.108182 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:07:35.108182 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:07:35.108182 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:07:35.108182 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:07:35.108182 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:07:35.108182 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:07:35.108182 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 18:07:35.108182 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 18:07:35.108182 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9947ad7c-1b7a-4db5-8968-94691c54575a could not be found. Jul 14 18:07:35.108182 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:07:35.109668 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-1b6b1caa-b2a0-4545-a661-2db691508334 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Returning 404 to user: Instance 9947ad7c-1b7a-4db5-8968-94691c54575a could not be found. {{(pid=129471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:07:35.109668 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-1b6b1caa-b2a0-4545-a661-2db691508334 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a" status: 404 len: 111 microversion: 2.1 time: 0.031369 Jul 14 18:07:35.109668 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 595/1148] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:07:35 2022] GET /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 18:07:35.115064 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-4834b64d-b792-4640-a644-ea75a6222e99 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '.version_select at 0x7f13801770d0>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:07:35.135906 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-4834b64d-b792-4640-a644-ea75a6222e99 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-908342956" status: 202 len: 0 microversion: 2.1 time: 0.024974 Jul 14 18:07:35.136512 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 554/1149] 10.222.0.64 () {58 vars in 1217 bytes} [Thu Jul 14 18:07:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-908342956 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 18:07:35.804609 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-eb103a78-99fe-4368-9c40-734cd3798aaf tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:07:35.805107 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-eb103a78-99fe-4368-9c40-734cd3798aaf tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 939413a2-1f95-42f5-ad28-5fd1470b709f] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:07:35.811645 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-eb103a78-99fe-4368-9c40-734cd3798aaf tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:35.812142 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-eb103a78-99fe-4368-9c40-734cd3798aaf tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:35.812905 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-eb103a78-99fe-4368-9c40-734cd3798aaf tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:35.813344 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-eb103a78-99fe-4368-9c40-734cd3798aaf tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:35.894322 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.objects.instance [None req-eb103a78-99fe-4368-9c40-734cd3798aaf tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lazy-loading 'services' on Instance uuid 939413a2-1f95-42f5-ad28-5fd1470b709f {{(pid=129471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 18:07:35.965325 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-eb103a78-99fe-4368-9c40-734cd3798aaf tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "DELETE /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f/os-volume_attachments/6c21e902-855b-48ca-aa86-a9bf28fccabe" status: 202 len: 0 microversion: 2.1 time: 0.164702 Jul 14 18:07:35.965906 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 596/1150] 10.222.0.64 () {58 vars in 1415 bytes} [Thu Jul 14 18:07:35 2022] DELETE /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f/os-volume_attachments/6c21e902-855b-48ca-aa86-a9bf28fccabe => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 18:07:35.975517 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-23e2e481-122b-4bca-9fef-d553708d8bb7 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:07:35.976652 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-23e2e481-122b-4bca-9fef-d553708d8bb7 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 939413a2-1f95-42f5-ad28-5fd1470b709f] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:07:35.984472 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-23e2e481-122b-4bca-9fef-d553708d8bb7 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:35.985531 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-23e2e481-122b-4bca-9fef-d553708d8bb7 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:35.986719 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-23e2e481-122b-4bca-9fef-d553708d8bb7 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:35.987170 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-23e2e481-122b-4bca-9fef-d553708d8bb7 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:36.016938 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-23e2e481-122b-4bca-9fef-d553708d8bb7 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045902 Jul 14 18:07:36.017428 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 555/1151] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Jul 14 18:07:35 2022] GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:07:37.032506 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-d57e12d9-17d0-4115-9648-a08edc6ff7e9 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:07:37.033576 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-d57e12d9-17d0-4115-9648-a08edc6ff7e9 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 939413a2-1f95-42f5-ad28-5fd1470b709f] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:07:37.039796 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d57e12d9-17d0-4115-9648-a08edc6ff7e9 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:37.040281 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d57e12d9-17d0-4115-9648-a08edc6ff7e9 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:37.041060 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d57e12d9-17d0-4115-9648-a08edc6ff7e9 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:37.041498 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d57e12d9-17d0-4115-9648-a08edc6ff7e9 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:37.070051 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-d57e12d9-17d0-4115-9648-a08edc6ff7e9 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042422 Jul 14 18:07:37.070589 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 597/1152] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Jul 14 18:07:37 2022] GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 18:07:37.127903 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-08b817c9-7466-412d-8628-e7b669fbf970 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:07:37.128477 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-08b817c9-7466-412d-8628-e7b669fbf970 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 939413a2-1f95-42f5-ad28-5fd1470b709f] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:07:37.134395 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-08b817c9-7466-412d-8628-e7b669fbf970 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:37.134846 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-08b817c9-7466-412d-8628-e7b669fbf970 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:37.136261 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-08b817c9-7466-412d-8628-e7b669fbf970 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:37.136703 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-08b817c9-7466-412d-8628-e7b669fbf970 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:37.163096 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-08b817c9-7466-412d-8628-e7b669fbf970 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 939413a2-1f95-42f5-ad28-5fd1470b709f] Going to try to terminate instance {{(pid=129470) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 18:07:37.236754 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-08b817c9-7466-412d-8628-e7b669fbf970 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "DELETE /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f" status: 204 len: 0 microversion: 2.1 time: 0.112557 Jul 14 18:07:37.237523 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 556/1153] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Jul 14 18:07:37 2022] DELETE /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 18:07:37.248439 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-4afb3378-4d6b-42b1-bfc4-bd810cc8471b tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:07:37.249049 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-4afb3378-4d6b-42b1-bfc4-bd810cc8471b tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 939413a2-1f95-42f5-ad28-5fd1470b709f] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:07:37.255039 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4afb3378-4d6b-42b1-bfc4-bd810cc8471b tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:37.255489 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4afb3378-4d6b-42b1-bfc4-bd810cc8471b tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:37.256278 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4afb3378-4d6b-42b1-bfc4-bd810cc8471b tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:37.256826 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-4afb3378-4d6b-42b1-bfc4-bd810cc8471b tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:37.386684 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-4afb3378-4d6b-42b1-bfc4-bd810cc8471b tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:07:37.395240 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-4afb3378-4d6b-42b1-bfc4-bd810cc8471b tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f" status: 200 len: 1679 microversion: 2.1 time: 0.151555 Jul 14 18:07:37.395815 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 598/1154] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:07:37 2022] GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:07:38.413665 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-8f3c0b28-6f26-4e53-9451-ab1831ec7c3f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:07:38.414285 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-8f3c0b28-6f26-4e53-9451-ab1831ec7c3f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 939413a2-1f95-42f5-ad28-5fd1470b709f] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:07:38.420928 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8f3c0b28-6f26-4e53-9451-ab1831ec7c3f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:38.421387 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8f3c0b28-6f26-4e53-9451-ab1831ec7c3f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:38.422161 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8f3c0b28-6f26-4e53-9451-ab1831ec7c3f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:38.422599 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8f3c0b28-6f26-4e53-9451-ab1831ec7c3f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:38.553442 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-8f3c0b28-6f26-4e53-9451-ab1831ec7c3f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:07:38.561535 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-8f3c0b28-6f26-4e53-9451-ab1831ec7c3f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f" status: 200 len: 1679 microversion: 2.1 time: 0.152211 Jul 14 18:07:38.562116 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 557/1155] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:07:38 2022] GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:07:39.578682 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-3e8d4f7f-5fd1-454e-8299-cfc8705d9674 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:07:39.579279 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-3e8d4f7f-5fd1-454e-8299-cfc8705d9674 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 939413a2-1f95-42f5-ad28-5fd1470b709f] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:07:39.585821 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3e8d4f7f-5fd1-454e-8299-cfc8705d9674 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:39.586272 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3e8d4f7f-5fd1-454e-8299-cfc8705d9674 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:39.587049 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3e8d4f7f-5fd1-454e-8299-cfc8705d9674 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:39.587487 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3e8d4f7f-5fd1-454e-8299-cfc8705d9674 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:39.723621 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-3e8d4f7f-5fd1-454e-8299-cfc8705d9674 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:07:39.731396 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-3e8d4f7f-5fd1-454e-8299-cfc8705d9674 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f" status: 200 len: 1679 microversion: 2.1 time: 0.156583 Jul 14 18:07:39.731992 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 599/1156] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:07:39 2022] GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:07:39.951567 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-5f188e7a-be28-466f-be1b-c662e5a3950f req-76c634e1-3009-4e4f-8675-b11a97834cba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "939413a2-1f95-42f5-ad28-5fd1470b709f", "name": "network-vif-deleted", "tag": "db745698-bdb6-48c6-af8f-bc37b9606371"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:07:39.960732 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-5f188e7a-be28-466f-be1b-c662e5a3950f req-76c634e1-3009-4e4f-8675-b11a97834cba service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:39.961110 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-5f188e7a-be28-466f-be1b-c662e5a3950f req-76c634e1-3009-4e4f-8675-b11a97834cba service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:39.972693 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-5f188e7a-be28-466f-be1b-c662e5a3950f req-76c634e1-3009-4e4f-8675-b11a97834cba service nova] Creating event network-vif-deleted:db745698-bdb6-48c6-af8f-bc37b9606371 for instance 939413a2-1f95-42f5-ad28-5fd1470b709f on hv-cinder-84989 Jul 14 18:07:39.977676 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-5f188e7a-be28-466f-be1b-c662e5a3950f req-76c634e1-3009-4e4f-8675-b11a97834cba service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030246 Jul 14 18:07:39.978318 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 558/1157] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:07:40.749237 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-209a53c9-11e3-48c5-b9ab-7260cdbb8672 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:07:40.749850 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-209a53c9-11e3-48c5-b9ab-7260cdbb8672 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 939413a2-1f95-42f5-ad28-5fd1470b709f] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:07:40.756660 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-209a53c9-11e3-48c5-b9ab-7260cdbb8672 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:40.757104 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-209a53c9-11e3-48c5-b9ab-7260cdbb8672 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:40.757876 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-209a53c9-11e3-48c5-b9ab-7260cdbb8672 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:40.758309 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-209a53c9-11e3-48c5-b9ab-7260cdbb8672 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:40.774294 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.wsgi [None req-209a53c9-11e3-48c5-b9ab-7260cdbb8672 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] HTTP exception thrown: Instance 939413a2-1f95-42f5-ad28-5fd1470b709f could not be found. Jul 14 18:07:40.775972 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-209a53c9-11e3-48c5-b9ab-7260cdbb8672 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Request method failure captured: Jul 14 18:07:40.775972 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: request: GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f HTTP/1.1 Jul 14 18:07:40.775972 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept: application/json Jul 14 18:07:40.775972 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept-Encoding: identity Jul 14 18:07:40.775972 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Connection: close Jul 14 18:07:40.775972 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Length: 0 Jul 14 18:07:40.775972 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Type: application/json Jul 14 18:07:40.775972 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Host: 10.222.0.64 Jul 14 18:07:40.775972 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Openstack-System-Scope: None Jul 14 18:07:40.775972 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: User-Agent: python-urllib3/1.26.9 Jul 14 18:07:40.775972 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Auth-Token: gAAAAABi0FqQJwSdeIlyvTJTebGB2HswWMQXdEeVQ1nqnsr0mN7imW5yYBtB7v0AYBUvhZx3ERaakjDBC-y17nbWzPHdLShTJjvjoOWOEu2O2dHU4WvbtqYTFlYdN2M2cROj3RwdhDe-fwWgM_ya_OxtW44tU56VzqdTH9IrVrscBvrZes_8UeI Jul 14 18:07:40.775972 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Id: None Jul 14 18:07:40.775972 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Name: None Jul 14 18:07:40.775972 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Identity-Status: Confirmed Jul 14 18:07:40.775972 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Is-Admin-Project: True Jul 14 18:07:40.775972 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Id: default Jul 14 18:07:40.775972 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Name: Default Jul 14 18:07:40.775972 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Id: cd7b0d70fffe4d37a84bd4ee73d044ca Jul 14 18:07:40.775972 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Name: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:07:40.775972 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Role: reader,member Jul 14 18:07:40.775972 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Roles: reader,member Jul 14 18:07:40.777598 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cd7b0d70fffe4d37a84bd4ee73d044ca", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:07:40.777598 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:07:40.777598 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Id: cd7b0d70fffe4d37a84bd4ee73d044ca Jul 14 18:07:40.777598 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:07:40.777598 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User: tempest-AttachVolumeNegativeTest-775141180-project Jul 14 18:07:40.777598 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Id: default Jul 14 18:07:40.777598 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Name: Default Jul 14 18:07:40.777598 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Id: d1a7b2376e83489b87feb4b9fd449d55 Jul 14 18:07:40.777598 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Name: tempest-AttachVolumeNegativeTest-775141180-project Jul 14 18:07:40.777598 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: method: > Jul 14 18:07:40.777598 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: exception: Instance 939413a2-1f95-42f5-ad28-5fd1470b709f could not be found. Jul 14 18:07:40.777598 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: action_args: {'id': '939413a2-1f95-42f5-ad28-5fd1470b709f'} Jul 14 18:07:40.778453 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:07:40.778453 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:07:40.778453 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 18:07:40.778453 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 18:07:40.778453 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 18:07:40.778453 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 18:07:40.778453 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 18:07:40.778453 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 18:07:40.778453 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 18:07:40.778453 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 18:07:40.778453 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 939413a2-1f95-42f5-ad28-5fd1470b709f could not be found. Jul 14 18:07:40.778453 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:07:40.778453 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:07:40.778453 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:07:40.778453 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:07:40.778453 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:07:40.778453 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:07:40.778453 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:07:40.778453 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:07:40.778453 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:07:40.779820 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:07:40.779820 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 18:07:40.779820 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 18:07:40.779820 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 18:07:40.779820 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 18:07:40.779820 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 18:07:40.779820 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 18:07:40.779820 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 939413a2-1f95-42f5-ad28-5fd1470b709f could not be found. Jul 14 18:07:40.779820 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:07:40.779820 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:07:40.779820 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:07:40.779820 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:07:40.779820 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:07:40.779820 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:07:40.779820 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 18:07:40.779820 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 18:07:40.779820 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 939413a2-1f95-42f5-ad28-5fd1470b709f could not be found. Jul 14 18:07:40.779820 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:07:40.781176 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-209a53c9-11e3-48c5-b9ab-7260cdbb8672 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Returning 404 to user: Instance 939413a2-1f95-42f5-ad28-5fd1470b709f could not be found. {{(pid=129471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:07:40.781176 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-209a53c9-11e3-48c5-b9ab-7260cdbb8672 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f" status: 404 len: 111 microversion: 2.1 time: 0.032775 Jul 14 18:07:40.781176 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 600/1158] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:07:40 2022] GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 18:07:40.787178 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-9423c741-9356-4bf4-9ece-bd6c2d3739cf tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '.version_select at 0x7f1380133700>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:07:40.808343 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-9423c741-9356-4bf4-9ece-bd6c2d3739cf tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-451777761" status: 202 len: 0 microversion: 2.1 time: 0.025275 Jul 14 18:07:40.808870 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 559/1159] 10.222.0.64 () {58 vars in 1217 bytes} [Thu Jul 14 18:07:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-451777761 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 18:07:41.417376 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-3e6904de-3987-47d8-85c7-9ece9135cda3 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Action: 'create', calling method: .version_select at 0x7f137b54ae50>, body: {"keypair": {"name": "tempest-keypair-1864853297", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQPwGDsCfrZWHx3UlFTsZJRU5jZjVLFxQgaTnr6XQiID+snVq2QLhi7y4Jp2JMgImRxnFioFHhClN8IXHZVaBcRFc+/OsLQ0zZF3HhO2rvjk3rTXkDffUOmKaWiyE2OBw=="}} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:07:41.431392 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.quota [None req-3e6904de-3987-47d8-85c7-9ece9135cda3 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Getting quotas for project cd7b0d70fffe4d37a84bd4ee73d044ca. Resources: {'key_pairs'} {{(pid=129471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 18:07:41.435174 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.quota [None req-3e6904de-3987-47d8-85c7-9ece9135cda3 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Getting quotas for user d1a7b2376e83489b87feb4b9fd449d55 and project cd7b0d70fffe4d37a84bd4ee73d044ca. Resources: {'key_pairs'} {{(pid=129471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 18:07:41.459625 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-3e6904de-3987-47d8-85c7-9ece9135cda3 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045995 Jul 14 18:07:41.460511 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 601/1160] 10.222.0.64 () {60 vars in 1158 bytes} [Thu Jul 14 18:07:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:07:42.666533 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-7b989a9e-24e5-41b7-8068-a7f9c3297cf5 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1670741394", "imageRef": "cf1f5d8c-9e49-4272-8e19-8e3c587056e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d836dc14-adcd-46d4-983c-5e81fdb4ff39"}], "security_groups": [{"name": "tempest-securitygroup--2026440056"}], "key_name": "tempest-keypair-1864853297", "user_data": "}} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:07:42.767357 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.network.neutron [None req-7b989a9e-24e5-41b7-8068-a7f9c3297cf5 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] validate_networks() for [('d836dc14-adcd-46d4-983c-5e81fdb4ff39', None, None, None, None, None)] {{(pid=129470) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 18:07:43.128508 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-7b989a9e-24e5-41b7-8068-a7f9c3297cf5 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Flavor limits 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 18:07:43.128962 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-7b989a9e-24e5-41b7-8068-a7f9c3297cf5 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Image limits 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 18:07:43.129439 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-7b989a9e-24e5-41b7-8068-a7f9c3297cf5 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Flavor pref 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 18:07:43.129851 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-7b989a9e-24e5-41b7-8068-a7f9c3297cf5 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Image pref 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 18:07:43.130261 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-7b989a9e-24e5-41b7-8068-a7f9c3297cf5 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 18:07:43.139008 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7b989a9e-24e5-41b7-8068-a7f9c3297cf5 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:43.139452 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7b989a9e-24e5-41b7-8068-a7f9c3297cf5 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:43.140280 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7b989a9e-24e5-41b7-8068-a7f9c3297cf5 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:43.140772 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7b989a9e-24e5-41b7-8068-a7f9c3297cf5 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:43.157245 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.quota [None req-7b989a9e-24e5-41b7-8068-a7f9c3297cf5 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Getting quotas for project cd7b0d70fffe4d37a84bd4ee73d044ca. Resources: {'ram', 'cores', 'instances'} {{(pid=129470) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 18:07:43.161075 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.quota [None req-7b989a9e-24e5-41b7-8068-a7f9c3297cf5 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Getting quotas for user d1a7b2376e83489b87feb4b9fd449d55 and project cd7b0d70fffe4d37a84bd4ee73d044ca. Resources: {'ram', 'cores', 'instances'} {{(pid=129470) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 18:07:43.172377 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-7b989a9e-24e5-41b7-8068-a7f9c3297cf5 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Going to run 1 instances... {{(pid=129470) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 18:07:43.174744 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-7b989a9e-24e5-41b7-8068-a7f9c3297cf5 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 845aadfa-e6fd-491a-86bb-0534aa1a45fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf1f5d8c-9e49-4272-8e19-8e3c587056e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129470) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 18:07:43.221023 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-7b989a9e-24e5-41b7-8068-a7f9c3297cf5 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.559898 Jul 14 18:07:43.221673 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 560/1161] 10.222.0.64 () {60 vars in 1146 bytes} [Thu Jul 14 18:07:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 18:07:43.232691 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-65f5dfd2-e772-443c-8875-0f7a443dc303 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:07:43.233314 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-65f5dfd2-e772-443c-8875-0f7a443dc303 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 845aadfa-e6fd-491a-86bb-0534aa1a45fd] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:07:43.289014 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-65f5dfd2-e772-443c-8875-0f7a443dc303 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:07:43.297590 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-65f5dfd2-e772-443c-8875-0f7a443dc303 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd" status: 200 len: 1242 microversion: 2.1 time: 0.069739 Jul 14 18:07:43.298163 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 602/1162] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:07:43 2022] GET /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd => generated 1242 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:07:44.316552 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-6b20ca01-0577-4991-b7c2-addeeb23e8e9 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:07:44.317067 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-6b20ca01-0577-4991-b7c2-addeeb23e8e9 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 845aadfa-e6fd-491a-86bb-0534aa1a45fd] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:07:44.324282 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6b20ca01-0577-4991-b7c2-addeeb23e8e9 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:44.324863 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6b20ca01-0577-4991-b7c2-addeeb23e8e9 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:44.325748 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6b20ca01-0577-4991-b7c2-addeeb23e8e9 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:44.326273 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6b20ca01-0577-4991-b7c2-addeeb23e8e9 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:44.388420 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-6b20ca01-0577-4991-b7c2-addeeb23e8e9 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:07:44.395948 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-6b20ca01-0577-4991-b7c2-addeeb23e8e9 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd" status: 200 len: 1300 microversion: 2.1 time: 0.084753 Jul 14 18:07:44.396508 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 561/1163] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:07:44 2022] GET /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd => generated 1300 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:07:45.413619 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-2eb20506-4049-4568-91eb-390812312efc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:07:45.414233 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-2eb20506-4049-4568-91eb-390812312efc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 845aadfa-e6fd-491a-86bb-0534aa1a45fd] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:07:45.421049 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2eb20506-4049-4568-91eb-390812312efc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:45.421494 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2eb20506-4049-4568-91eb-390812312efc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:45.422256 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2eb20506-4049-4568-91eb-390812312efc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:45.422688 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2eb20506-4049-4568-91eb-390812312efc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:45.566146 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-2eb20506-4049-4568-91eb-390812312efc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:07:45.574919 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-2eb20506-4049-4568-91eb-390812312efc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd" status: 200 len: 1368 microversion: 2.1 time: 0.165621 Jul 14 18:07:45.576408 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 603/1164] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:07:45 2022] GET /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:07:45.673295 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-e9a7267a-ca23-4d66-a172-e8b7fdbaf165 req-d270848a-d4ad-4ab6-9ef2-f6f14774dc12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "845aadfa-e6fd-491a-86bb-0534aa1a45fd", "tag": "899d1c41-12ca-4597-8f9e-55a390ce901b"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:07:45.687173 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-e9a7267a-ca23-4d66-a172-e8b7fdbaf165 req-d270848a-d4ad-4ab6-9ef2-f6f14774dc12 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:45.687633 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-e9a7267a-ca23-4d66-a172-e8b7fdbaf165 req-d270848a-d4ad-4ab6-9ef2-f6f14774dc12 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:45.700066 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-e9a7267a-ca23-4d66-a172-e8b7fdbaf165 req-d270848a-d4ad-4ab6-9ef2-f6f14774dc12 service nova] Creating event network-changed:899d1c41-12ca-4597-8f9e-55a390ce901b for instance 845aadfa-e6fd-491a-86bb-0534aa1a45fd on hv-cinder-84989 Jul 14 18:07:45.705379 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-e9a7267a-ca23-4d66-a172-e8b7fdbaf165 req-d270848a-d4ad-4ab6-9ef2-f6f14774dc12 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037059 Jul 14 18:07:45.706167 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 562/1165] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:07:46.593135 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-f68d0eb6-3c7e-4a78-85ca-b4991a15c80f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:07:46.593769 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-f68d0eb6-3c7e-4a78-85ca-b4991a15c80f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 845aadfa-e6fd-491a-86bb-0534aa1a45fd] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:07:46.600263 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f68d0eb6-3c7e-4a78-85ca-b4991a15c80f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:46.600715 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f68d0eb6-3c7e-4a78-85ca-b4991a15c80f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:46.601475 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f68d0eb6-3c7e-4a78-85ca-b4991a15c80f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:46.601926 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f68d0eb6-3c7e-4a78-85ca-b4991a15c80f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:46.729632 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-f68d0eb6-3c7e-4a78-85ca-b4991a15c80f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:07:46.737053 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-f68d0eb6-3c7e-4a78-85ca-b4991a15c80f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd" status: 200 len: 1368 microversion: 2.1 time: 0.147761 Jul 14 18:07:46.737626 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 604/1166] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:07:46 2022] GET /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:07:47.754892 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-9024dcf5-cb02-4524-a0e4-7cfbb9335430 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:07:47.755597 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-9024dcf5-cb02-4524-a0e4-7cfbb9335430 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 845aadfa-e6fd-491a-86bb-0534aa1a45fd] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:07:47.762586 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9024dcf5-cb02-4524-a0e4-7cfbb9335430 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:47.763044 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9024dcf5-cb02-4524-a0e4-7cfbb9335430 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:47.763820 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9024dcf5-cb02-4524-a0e4-7cfbb9335430 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:47.764290 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9024dcf5-cb02-4524-a0e4-7cfbb9335430 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:47.893566 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-9024dcf5-cb02-4524-a0e4-7cfbb9335430 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:07:47.901545 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-9024dcf5-cb02-4524-a0e4-7cfbb9335430 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd" status: 200 len: 1368 microversion: 2.1 time: 0.151415 Jul 14 18:07:47.902113 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 563/1167] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:07:47 2022] GET /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:07:48.918135 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-5e5c143f-2c64-4d92-9588-c1929c0121e9 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:07:48.918783 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-5e5c143f-2c64-4d92-9588-c1929c0121e9 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 845aadfa-e6fd-491a-86bb-0534aa1a45fd] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:07:48.925179 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5e5c143f-2c64-4d92-9588-c1929c0121e9 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:48.925876 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5e5c143f-2c64-4d92-9588-c1929c0121e9 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:48.926636 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5e5c143f-2c64-4d92-9588-c1929c0121e9 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:48.927078 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-5e5c143f-2c64-4d92-9588-c1929c0121e9 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:49.056524 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-5e5c143f-2c64-4d92-9588-c1929c0121e9 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:07:49.064155 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-5e5c143f-2c64-4d92-9588-c1929c0121e9 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd" status: 200 len: 1368 microversion: 2.1 time: 0.150489 Jul 14 18:07:49.064726 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 605/1168] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:07:48 2022] GET /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:07:50.081138 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-750006fa-f5b7-4d47-92cc-41e38541715f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:07:50.081744 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-750006fa-f5b7-4d47-92cc-41e38541715f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 845aadfa-e6fd-491a-86bb-0534aa1a45fd] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:07:50.088770 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-750006fa-f5b7-4d47-92cc-41e38541715f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:50.089220 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-750006fa-f5b7-4d47-92cc-41e38541715f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:50.089995 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-750006fa-f5b7-4d47-92cc-41e38541715f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:50.090435 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-750006fa-f5b7-4d47-92cc-41e38541715f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:50.225167 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-750006fa-f5b7-4d47-92cc-41e38541715f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:07:50.232720 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-750006fa-f5b7-4d47-92cc-41e38541715f tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd" status: 200 len: 1368 microversion: 2.1 time: 0.155481 Jul 14 18:07:50.233304 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 564/1169] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:07:50 2022] GET /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:07:51.250038 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-8943bf53-2245-4c0e-a055-a469da90ff69 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:07:51.250706 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-8943bf53-2245-4c0e-a055-a469da90ff69 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 845aadfa-e6fd-491a-86bb-0534aa1a45fd] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:07:51.257248 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8943bf53-2245-4c0e-a055-a469da90ff69 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:51.257703 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8943bf53-2245-4c0e-a055-a469da90ff69 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:51.258473 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8943bf53-2245-4c0e-a055-a469da90ff69 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:51.258919 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8943bf53-2245-4c0e-a055-a469da90ff69 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:51.385410 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-8943bf53-2245-4c0e-a055-a469da90ff69 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:07:51.392795 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-8943bf53-2245-4c0e-a055-a469da90ff69 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd" status: 200 len: 1368 microversion: 2.1 time: 0.146670 Jul 14 18:07:51.393360 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 606/1170] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:07:51 2022] GET /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 18:07:51.594921 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-1d07350b-fcda-4520-bf86-a8d5039e3718 req-4dd0d775-94b9-4394-a10d-50229110b6f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "845aadfa-e6fd-491a-86bb-0534aa1a45fd", "name": "network-vif-plugged", "status": "completed", "tag": "899d1c41-12ca-4597-8f9e-55a390ce901b"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:07:51.604430 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-1d07350b-fcda-4520-bf86-a8d5039e3718 req-4dd0d775-94b9-4394-a10d-50229110b6f2 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:51.604968 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-1d07350b-fcda-4520-bf86-a8d5039e3718 req-4dd0d775-94b9-4394-a10d-50229110b6f2 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:51.616235 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-1d07350b-fcda-4520-bf86-a8d5039e3718 req-4dd0d775-94b9-4394-a10d-50229110b6f2 service nova] Creating event network-vif-plugged:899d1c41-12ca-4597-8f9e-55a390ce901b for instance 845aadfa-e6fd-491a-86bb-0534aa1a45fd on hv-cinder-84989 Jul 14 18:07:51.621183 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-1d07350b-fcda-4520-bf86-a8d5039e3718 req-4dd0d775-94b9-4394-a10d-50229110b6f2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029877 Jul 14 18:07:51.621871 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 565/1171] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:07:52.410257 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-72251db8-3365-44ce-b308-95a1a27ecd96 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:07:52.410796 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-72251db8-3365-44ce-b308-95a1a27ecd96 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 845aadfa-e6fd-491a-86bb-0534aa1a45fd] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:07:52.417949 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-72251db8-3365-44ce-b308-95a1a27ecd96 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:52.418403 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-72251db8-3365-44ce-b308-95a1a27ecd96 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:52.419185 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-72251db8-3365-44ce-b308-95a1a27ecd96 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:52.419624 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-72251db8-3365-44ce-b308-95a1a27ecd96 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:52.552668 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-72251db8-3365-44ce-b308-95a1a27ecd96 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:07:52.560714 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-72251db8-3365-44ce-b308-95a1a27ecd96 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd" status: 200 len: 1368 microversion: 2.1 time: 0.154460 Jul 14 18:07:52.561280 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 607/1172] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:07:52 2022] GET /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:07:53.575690 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell0:SELECT=2 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:07:53.576568 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell0:SELECT=6 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:07:53.580914 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-f3ac115b-f241-4e73-b54f-6f1e36a123fe tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:07:53.581607 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-f3ac115b-f241-4e73-b54f-6f1e36a123fe tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 845aadfa-e6fd-491a-86bb-0534aa1a45fd] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:07:53.589196 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f3ac115b-f241-4e73-b54f-6f1e36a123fe tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:53.589647 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f3ac115b-f241-4e73-b54f-6f1e36a123fe tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:53.590404 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f3ac115b-f241-4e73-b54f-6f1e36a123fe tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:53.590839 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f3ac115b-f241-4e73-b54f-6f1e36a123fe tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:53.719571 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-f3ac115b-f241-4e73-b54f-6f1e36a123fe tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:07:53.727094 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-f3ac115b-f241-4e73-b54f-6f1e36a123fe tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd" status: 200 len: 1558 microversion: 2.1 time: 0.152986 Jul 14 18:07:53.728284 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 566/1173] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:07:53 2022] GET /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 18:07:53.743890 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-6cac37c8-fde0-4c39-8731-0f77d1bfe88d tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:07:53.744412 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-6cac37c8-fde0-4c39-8731-0f77d1bfe88d tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 845aadfa-e6fd-491a-86bb-0534aa1a45fd] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:07:53.746390 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell0:SELECT=6 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:07:53.752053 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6cac37c8-fde0-4c39-8731-0f77d1bfe88d tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:53.752503 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6cac37c8-fde0-4c39-8731-0f77d1bfe88d tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:53.753309 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6cac37c8-fde0-4c39-8731-0f77d1bfe88d tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:53.753745 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6cac37c8-fde0-4c39-8731-0f77d1bfe88d tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:53.831941 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-6cac37c8-fde0-4c39-8731-0f77d1bfe88d tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091829 Jul 14 18:07:53.832561 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 608/1174] 10.222.0.64 () {58 vars in 1274 bytes} [Thu Jul 14 18:07:53 2022] GET /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:07:54.739228 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-d52b25a9-8ee5-496e-bdea-400b815e0890 req-8a724a47-57ec-48b1-84c8-fa0529321dd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "845aadfa-e6fd-491a-86bb-0534aa1a45fd", "tag": "899d1c41-12ca-4597-8f9e-55a390ce901b"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:07:54.748783 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-d52b25a9-8ee5-496e-bdea-400b815e0890 req-8a724a47-57ec-48b1-84c8-fa0529321dd3 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:07:54.749229 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-d52b25a9-8ee5-496e-bdea-400b815e0890 req-8a724a47-57ec-48b1-84c8-fa0529321dd3 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:07:54.760557 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-d52b25a9-8ee5-496e-bdea-400b815e0890 req-8a724a47-57ec-48b1-84c8-fa0529321dd3 service nova] Creating event network-changed:899d1c41-12ca-4597-8f9e-55a390ce901b for instance 845aadfa-e6fd-491a-86bb-0534aa1a45fd on hv-cinder-84989 Jul 14 18:07:54.765515 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-d52b25a9-8ee5-496e-bdea-400b815e0890 req-8a724a47-57ec-48b1-84c8-fa0529321dd3 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029863 Jul 14 18:07:54.766222 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 567/1175] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:09:18.830983 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:09:18.831822 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=1 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:09:18.931222 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-cbc1075f-7272-48ad-8ced-8a0f685b2147 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:09:18.931727 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-cbc1075f-7272-48ad-8ced-8a0f685b2147 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 845aadfa-e6fd-491a-86bb-0534aa1a45fd] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:09:18.938148 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-cbc1075f-7272-48ad-8ced-8a0f685b2147 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:18.938599 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-cbc1075f-7272-48ad-8ced-8a0f685b2147 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:18.939377 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-cbc1075f-7272-48ad-8ced-8a0f685b2147 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:18.939818 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-cbc1075f-7272-48ad-8ced-8a0f685b2147 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:18.966421 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-cbc1075f-7272-48ad-8ced-8a0f685b2147 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd/ips" status: 200 len: 150 microversion: 2.1 time: 0.137314 Jul 14 18:09:18.968216 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 609/1176] 10.222.0.64 () {58 vars in 1247 bytes} [Thu Jul 14 18:09:18 2022] GET /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd/ips => generated 150 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:09:20.321690 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:09:20.322437 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:09:20.327625 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-fcd6a527-1cf1-4b97-92e2-28477312b28e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e11610e-674c-4811-b1a8-702ca4c3d6a0"}} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:09:20.329059 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-fcd6a527-1cf1-4b97-92e2-28477312b28e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 845aadfa-e6fd-491a-86bb-0534aa1a45fd] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:09:20.338059 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fcd6a527-1cf1-4b97-92e2-28477312b28e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:20.338603 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fcd6a527-1cf1-4b97-92e2-28477312b28e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:20.339389 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fcd6a527-1cf1-4b97-92e2-28477312b28e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:20.339827 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fcd6a527-1cf1-4b97-92e2-28477312b28e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:20.611987 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-fcd6a527-1cf1-4b97-92e2-28477312b28e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "POST /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291929 Jul 14 18:09:20.612791 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 568/1177] 10.222.0.64 () {60 vars in 1322 bytes} [Thu Jul 14 18:09:20 2022] POST /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:09:28.109602 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-294f2433-1dc8-4e99-83c2-fc93881185bc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e11610e-674c-4811-b1a8-702ca4c3d6a0"}} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:09:28.110765 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-294f2433-1dc8-4e99-83c2-fc93881185bc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 845aadfa-e6fd-491a-86bb-0534aa1a45fd] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:09:28.117340 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-294f2433-1dc8-4e99-83c2-fc93881185bc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:28.117790 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-294f2433-1dc8-4e99-83c2-fc93881185bc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:28.118574 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-294f2433-1dc8-4e99-83c2-fc93881185bc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:28.119017 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-294f2433-1dc8-4e99-83c2-fc93881185bc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:28.198786 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.wsgi [None req-294f2433-1dc8-4e99-83c2-fc93881185bc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] HTTP exception thrown: Invalid volume: volume 2e11610e-674c-4811-b1a8-702ca4c3d6a0 is already attached to instances: 845aadfa-e6fd-491a-86bb-0534aa1a45fd Jul 14 18:09:28.200469 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-294f2433-1dc8-4e99-83c2-fc93881185bc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Request method failure captured: Jul 14 18:09:28.200469 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: request: POST /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd/os-volume_attachments HTTP/1.1 Jul 14 18:09:28.200469 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept: application/json Jul 14 18:09:28.200469 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept-Encoding: identity Jul 14 18:09:28.200469 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Connection: close Jul 14 18:09:28.200469 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Length: 74 Jul 14 18:09:28.200469 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Type: application/json Jul 14 18:09:28.200469 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Host: 10.222.0.64 Jul 14 18:09:28.200469 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Openstack-System-Scope: None Jul 14 18:09:28.200469 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: User-Agent: python-urllib3/1.26.9 Jul 14 18:09:28.200469 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Auth-Token: gAAAAABi0FqQJwSdeIlyvTJTebGB2HswWMQXdEeVQ1nqnsr0mN7imW5yYBtB7v0AYBUvhZx3ERaakjDBC-y17nbWzPHdLShTJjvjoOWOEu2O2dHU4WvbtqYTFlYdN2M2cROj3RwdhDe-fwWgM_ya_OxtW44tU56VzqdTH9IrVrscBvrZes_8UeI Jul 14 18:09:28.200469 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Id: None Jul 14 18:09:28.200469 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Name: None Jul 14 18:09:28.200469 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Identity-Status: Confirmed Jul 14 18:09:28.200469 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Is-Admin-Project: True Jul 14 18:09:28.200469 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Id: default Jul 14 18:09:28.200469 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Name: Default Jul 14 18:09:28.200469 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Id: cd7b0d70fffe4d37a84bd4ee73d044ca Jul 14 18:09:28.200469 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Name: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:09:28.200469 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Role: reader,member Jul 14 18:09:28.200469 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Roles: reader,member Jul 14 18:09:28.202223 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cd7b0d70fffe4d37a84bd4ee73d044ca", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:09:28.202223 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:09:28.202223 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Id: cd7b0d70fffe4d37a84bd4ee73d044ca Jul 14 18:09:28.202223 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:09:28.202223 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User: tempest-AttachVolumeNegativeTest-775141180-project Jul 14 18:09:28.202223 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Id: default Jul 14 18:09:28.202223 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Name: Default Jul 14 18:09:28.202223 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Id: d1a7b2376e83489b87feb4b9fd449d55 Jul 14 18:09:28.202223 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Name: tempest-AttachVolumeNegativeTest-775141180-project Jul 14 18:09:28.202223 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Jul 14 18:09:28.202223 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: {"volumeAttachment": {"volumeId": "2e11610e-674c-4811-b1a8-702ca4c3d6a0"}} Jul 14 18:09:28.202223 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: method: > Jul 14 18:09:28.203166 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: exception: Invalid volume: volume 2e11610e-674c-4811-b1a8-702ca4c3d6a0 is already attached to instances: 845aadfa-e6fd-491a-86bb-0534aa1a45fd Jul 14 18:09:28.203166 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: action_args: {'server_id': '845aadfa-e6fd-491a-86bb-0534aa1a45fd', 'body': {'volumeAttachment': {'volumeId': '2e11610e-674c-4811-b1a8-702ca4c3d6a0'}}} Jul 14 18:09:28.203166 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:09:28.203166 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:09:28.203166 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 18:09:28.203166 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 18:09:28.203166 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 18:09:28.203166 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 18:09:28.203166 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 18:09:28.203166 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 18:09:28.203166 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 14 18:09:28.203166 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 14 18:09:28.203166 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 14 18:09:28.203166 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 14 18:09:28.203166 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2e11610e-674c-4811-b1a8-702ca4c3d6a0 is already attached to instances: 845aadfa-e6fd-491a-86bb-0534aa1a45fd Jul 14 18:09:28.203166 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:09:28.203166 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:09:28.203166 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:09:28.203166 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:09:28.204507 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:09:28.204507 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:09:28.204507 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:09:28.204507 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:09:28.204507 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:09:28.204507 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:09:28.204507 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 18:09:28.204507 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 18:09:28.204507 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 18:09:28.204507 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 18:09:28.204507 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 18:09:28.204507 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 18:09:28.204507 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 14 18:09:28.204507 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 18:09:28.204507 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2e11610e-674c-4811-b1a8-702ca4c3d6a0 is already attached to instances: 845aadfa-e6fd-491a-86bb-0534aa1a45fd Jul 14 18:09:28.204507 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:09:28.204507 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:09:28.204507 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:09:28.204507 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:09:28.204507 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:09:28.205811 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:09:28.205811 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 18:09:28.205811 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 18:09:28.205811 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2e11610e-674c-4811-b1a8-702ca4c3d6a0 is already attached to instances: 845aadfa-e6fd-491a-86bb-0534aa1a45fd Jul 14 18:09:28.205811 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:09:28.205811 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-294f2433-1dc8-4e99-83c2-fc93881185bc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Returning 400 to user: Invalid volume: volume 2e11610e-674c-4811-b1a8-702ca4c3d6a0 is already attached to instances: 845aadfa-e6fd-491a-86bb-0534aa1a45fd {{(pid=129471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:09:28.205811 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-294f2433-1dc8-4e99-83c2-fc93881185bc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "POST /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096478 Jul 14 18:09:28.205811 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 610/1178] 10.222.0.64 () {60 vars in 1322 bytes} [Thu Jul 14 18:09:28 2022] POST /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 18:09:28.264995 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-a22a141d-edef-440c-a3da-2161ba018666 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:09:28.265674 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-a22a141d-edef-440c-a3da-2161ba018666 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 845aadfa-e6fd-491a-86bb-0534aa1a45fd] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:09:28.273160 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a22a141d-edef-440c-a3da-2161ba018666 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:28.273619 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a22a141d-edef-440c-a3da-2161ba018666 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:28.274390 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a22a141d-edef-440c-a3da-2161ba018666 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:28.274829 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a22a141d-edef-440c-a3da-2161ba018666 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:28.357575 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.objects.instance [None req-a22a141d-edef-440c-a3da-2161ba018666 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lazy-loading 'services' on Instance uuid 845aadfa-e6fd-491a-86bb-0534aa1a45fd {{(pid=129470) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 18:09:28.433882 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-a22a141d-edef-440c-a3da-2161ba018666 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "DELETE /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd/os-volume_attachments/2e11610e-674c-4811-b1a8-702ca4c3d6a0" status: 202 len: 0 microversion: 2.1 time: 0.173255 Jul 14 18:09:28.434606 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 569/1179] 10.222.0.64 () {58 vars in 1415 bytes} [Thu Jul 14 18:09:28 2022] DELETE /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd/os-volume_attachments/2e11610e-674c-4811-b1a8-702ca4c3d6a0 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 18:09:28.443954 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-10206150-9229-43f5-97ac-01bacf2a3540 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:09:28.444936 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-10206150-9229-43f5-97ac-01bacf2a3540 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 845aadfa-e6fd-491a-86bb-0534aa1a45fd] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:09:28.451045 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-10206150-9229-43f5-97ac-01bacf2a3540 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:28.451504 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-10206150-9229-43f5-97ac-01bacf2a3540 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:28.452402 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-10206150-9229-43f5-97ac-01bacf2a3540 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:28.452843 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-10206150-9229-43f5-97ac-01bacf2a3540 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:28.484150 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-10206150-9229-43f5-97ac-01bacf2a3540 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044683 Jul 14 18:09:28.484724 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 611/1180] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Jul 14 18:09:28 2022] GET /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:09:29.496729 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-28b904bf-d904-478a-82af-46a7c7217264 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:09:29.497836 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-28b904bf-d904-478a-82af-46a7c7217264 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 845aadfa-e6fd-491a-86bb-0534aa1a45fd] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:09:29.505193 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-28b904bf-d904-478a-82af-46a7c7217264 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:29.505647 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-28b904bf-d904-478a-82af-46a7c7217264 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:29.506505 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-28b904bf-d904-478a-82af-46a7c7217264 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:29.506950 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-28b904bf-d904-478a-82af-46a7c7217264 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:29.538875 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-28b904bf-d904-478a-82af-46a7c7217264 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047360 Jul 14 18:09:29.539366 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 570/1181] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Jul 14 18:09:29 2022] GET /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 18:09:29.601080 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-e357c8e6-5913-41c2-b071-a83cf5504154 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:09:29.601667 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-e357c8e6-5913-41c2-b071-a83cf5504154 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 845aadfa-e6fd-491a-86bb-0534aa1a45fd] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:09:29.608416 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e357c8e6-5913-41c2-b071-a83cf5504154 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:29.608869 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e357c8e6-5913-41c2-b071-a83cf5504154 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:29.609666 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e357c8e6-5913-41c2-b071-a83cf5504154 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:29.610113 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e357c8e6-5913-41c2-b071-a83cf5504154 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:29.638124 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-e357c8e6-5913-41c2-b071-a83cf5504154 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 845aadfa-e6fd-491a-86bb-0534aa1a45fd] Going to try to terminate instance {{(pid=129471) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 18:09:29.718906 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-e357c8e6-5913-41c2-b071-a83cf5504154 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "DELETE /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd" status: 204 len: 0 microversion: 2.1 time: 0.121511 Jul 14 18:09:29.719602 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 612/1182] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Jul 14 18:09:29 2022] DELETE /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 18:09:29.729036 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-6ccfcec9-cecf-4b08-8eef-4b45750bb6df tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:09:29.729849 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-6ccfcec9-cecf-4b08-8eef-4b45750bb6df tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 845aadfa-e6fd-491a-86bb-0534aa1a45fd] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:09:29.736797 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6ccfcec9-cecf-4b08-8eef-4b45750bb6df tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:29.737422 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6ccfcec9-cecf-4b08-8eef-4b45750bb6df tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:29.738293 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6ccfcec9-cecf-4b08-8eef-4b45750bb6df tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:29.738876 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6ccfcec9-cecf-4b08-8eef-4b45750bb6df tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:29.880031 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-6ccfcec9-cecf-4b08-8eef-4b45750bb6df tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:09:29.887906 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-6ccfcec9-cecf-4b08-8eef-4b45750bb6df tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd" status: 200 len: 1683 microversion: 2.1 time: 0.163541 Jul 14 18:09:29.888520 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 571/1183] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:09:29 2022] GET /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:09:30.906153 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-7a202fce-f84d-4826-b18a-1ac93836269b tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:09:30.906895 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-7a202fce-f84d-4826-b18a-1ac93836269b tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 845aadfa-e6fd-491a-86bb-0534aa1a45fd] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:09:30.914300 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7a202fce-f84d-4826-b18a-1ac93836269b tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:30.914747 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7a202fce-f84d-4826-b18a-1ac93836269b tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:30.915537 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7a202fce-f84d-4826-b18a-1ac93836269b tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:30.916009 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7a202fce-f84d-4826-b18a-1ac93836269b tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:31.052870 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-7a202fce-f84d-4826-b18a-1ac93836269b tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:09:31.061366 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-7a202fce-f84d-4826-b18a-1ac93836269b tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd" status: 200 len: 1683 microversion: 2.1 time: 0.159416 Jul 14 18:09:31.061951 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 613/1184] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:09:30 2022] GET /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:09:32.079709 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-b6025d6a-2e68-4f00-b59d-71e0a6905853 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:09:32.081260 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-b6025d6a-2e68-4f00-b59d-71e0a6905853 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 845aadfa-e6fd-491a-86bb-0534aa1a45fd] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:09:32.088093 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b6025d6a-2e68-4f00-b59d-71e0a6905853 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:32.088577 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b6025d6a-2e68-4f00-b59d-71e0a6905853 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:32.089376 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b6025d6a-2e68-4f00-b59d-71e0a6905853 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:32.089842 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b6025d6a-2e68-4f00-b59d-71e0a6905853 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:32.235005 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-b6025d6a-2e68-4f00-b59d-71e0a6905853 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:09:32.242708 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-b6025d6a-2e68-4f00-b59d-71e0a6905853 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd" status: 200 len: 1683 microversion: 2.1 time: 0.167750 Jul 14 18:09:32.243289 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 572/1185] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:09:32 2022] GET /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:09:32.669533 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [req-9ae83bd3-1422-431f-b620-b5574a13b8af req-087248c6-fc7f-46bb-b44e-5fc6152e6bcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "845aadfa-e6fd-491a-86bb-0534aa1a45fd", "name": "network-vif-deleted", "tag": "899d1c41-12ca-4597-8f9e-55a390ce901b"}]} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:09:32.680150 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-9ae83bd3-1422-431f-b620-b5574a13b8af req-087248c6-fc7f-46bb-b44e-5fc6152e6bcd service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:32.680598 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-9ae83bd3-1422-431f-b620-b5574a13b8af req-087248c6-fc7f-46bb-b44e-5fc6152e6bcd service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:32.692538 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.compute.server_external_events [req-9ae83bd3-1422-431f-b620-b5574a13b8af req-087248c6-fc7f-46bb-b44e-5fc6152e6bcd service nova] Creating event network-vif-deleted:899d1c41-12ca-4597-8f9e-55a390ce901b for instance 845aadfa-e6fd-491a-86bb-0534aa1a45fd on hv-cinder-84989 Jul 14 18:09:32.702799 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [req-9ae83bd3-1422-431f-b620-b5574a13b8af req-087248c6-fc7f-46bb-b44e-5fc6152e6bcd service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036992 Jul 14 18:09:32.704222 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 614/1186] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:09:33.259274 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-b59159a8-e7bb-4222-9e04-8ce5d9e4e9b8 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:09:33.259957 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-b59159a8-e7bb-4222-9e04-8ce5d9e4e9b8 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 845aadfa-e6fd-491a-86bb-0534aa1a45fd] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:09:33.266517 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b59159a8-e7bb-4222-9e04-8ce5d9e4e9b8 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:33.266967 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b59159a8-e7bb-4222-9e04-8ce5d9e4e9b8 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:33.267734 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b59159a8-e7bb-4222-9e04-8ce5d9e4e9b8 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:33.268199 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b59159a8-e7bb-4222-9e04-8ce5d9e4e9b8 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:33.282150 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.wsgi [None req-b59159a8-e7bb-4222-9e04-8ce5d9e4e9b8 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] HTTP exception thrown: Instance 845aadfa-e6fd-491a-86bb-0534aa1a45fd could not be found. Jul 14 18:09:33.283835 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-b59159a8-e7bb-4222-9e04-8ce5d9e4e9b8 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Request method failure captured: Jul 14 18:09:33.283835 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: request: GET /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd HTTP/1.1 Jul 14 18:09:33.283835 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept: application/json Jul 14 18:09:33.283835 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept-Encoding: identity Jul 14 18:09:33.283835 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Connection: close Jul 14 18:09:33.283835 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Length: 0 Jul 14 18:09:33.283835 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Type: application/json Jul 14 18:09:33.283835 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Host: 10.222.0.64 Jul 14 18:09:33.283835 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Openstack-System-Scope: None Jul 14 18:09:33.283835 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: User-Agent: python-urllib3/1.26.9 Jul 14 18:09:33.283835 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Auth-Token: gAAAAABi0FqQJwSdeIlyvTJTebGB2HswWMQXdEeVQ1nqnsr0mN7imW5yYBtB7v0AYBUvhZx3ERaakjDBC-y17nbWzPHdLShTJjvjoOWOEu2O2dHU4WvbtqYTFlYdN2M2cROj3RwdhDe-fwWgM_ya_OxtW44tU56VzqdTH9IrVrscBvrZes_8UeI Jul 14 18:09:33.283835 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Id: None Jul 14 18:09:33.283835 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Name: None Jul 14 18:09:33.283835 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Identity-Status: Confirmed Jul 14 18:09:33.283835 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Is-Admin-Project: True Jul 14 18:09:33.283835 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Id: default Jul 14 18:09:33.283835 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Name: Default Jul 14 18:09:33.283835 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Id: cd7b0d70fffe4d37a84bd4ee73d044ca Jul 14 18:09:33.283835 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Name: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:09:33.283835 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Role: reader,member Jul 14 18:09:33.283835 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Roles: reader,member Jul 14 18:09:33.286140 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cd7b0d70fffe4d37a84bd4ee73d044ca", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:09:33.286140 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:09:33.286140 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Id: cd7b0d70fffe4d37a84bd4ee73d044ca Jul 14 18:09:33.286140 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:09:33.286140 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User: tempest-AttachVolumeNegativeTest-775141180-project Jul 14 18:09:33.286140 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Id: default Jul 14 18:09:33.286140 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Name: Default Jul 14 18:09:33.286140 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Id: d1a7b2376e83489b87feb4b9fd449d55 Jul 14 18:09:33.286140 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Name: tempest-AttachVolumeNegativeTest-775141180-project Jul 14 18:09:33.286140 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: method: > Jul 14 18:09:33.286140 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: exception: Instance 845aadfa-e6fd-491a-86bb-0534aa1a45fd could not be found. Jul 14 18:09:33.286140 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: action_args: {'id': '845aadfa-e6fd-491a-86bb-0534aa1a45fd'} Jul 14 18:09:33.287320 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:09:33.287320 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:09:33.287320 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 18:09:33.287320 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 18:09:33.287320 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 18:09:33.287320 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 18:09:33.287320 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 18:09:33.287320 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 18:09:33.287320 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 18:09:33.287320 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 18:09:33.287320 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 845aadfa-e6fd-491a-86bb-0534aa1a45fd could not be found. Jul 14 18:09:33.287320 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:09:33.287320 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:09:33.287320 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:09:33.287320 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:09:33.287320 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:09:33.287320 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:09:33.287320 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:09:33.287320 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:09:33.287320 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:09:33.288676 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:09:33.288676 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 18:09:33.288676 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 18:09:33.288676 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 18:09:33.288676 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 18:09:33.288676 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 18:09:33.288676 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 18:09:33.288676 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 845aadfa-e6fd-491a-86bb-0534aa1a45fd could not be found. Jul 14 18:09:33.288676 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:09:33.288676 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:09:33.288676 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:09:33.288676 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:09:33.288676 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:09:33.288676 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:09:33.288676 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 18:09:33.288676 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 18:09:33.288676 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 845aadfa-e6fd-491a-86bb-0534aa1a45fd could not be found. Jul 14 18:09:33.288676 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:09:33.289995 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-b59159a8-e7bb-4222-9e04-8ce5d9e4e9b8 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Returning 404 to user: Instance 845aadfa-e6fd-491a-86bb-0534aa1a45fd could not be found. {{(pid=129470) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:09:33.289995 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-b59159a8-e7bb-4222-9e04-8ce5d9e4e9b8 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd" status: 404 len: 111 microversion: 2.1 time: 0.030434 Jul 14 18:09:33.289995 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 573/1187] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:09:33 2022] GET /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 18:09:33.296118 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-eeaa5a97-7874-4542-94de-f39fca6241b5 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '.version_select at 0x7f137b54af70>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:09:33.315326 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-eeaa5a97-7874-4542-94de-f39fca6241b5 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1864853297" status: 202 len: 0 microversion: 2.1 time: 0.023811 Jul 14 18:09:33.315915 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 615/1188] 10.222.0.64 () {58 vars in 1220 bytes} [Thu Jul 14 18:09:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1864853297 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 18:09:33.977825 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-8232d0c1-083e-446e-a424-e88887eca86d tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Action: 'create', calling method: .version_select at 0x7f13800aeaf0>, body: {"keypair": {"name": "tempest-keypair-1899848401", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNtZ5NIArvToGXtyW8E04FgfTqim4rlclrSumONdcCfLMiPkVMBnmfRTC8URNc6XdEogQ9QtV4u47JrwL9cQ9V0kHWQWkH1IxNhA2WanbUIL0QqtHCKZoQ1g/eeSPinjA=="}} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:09:33.991706 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.quota [None req-8232d0c1-083e-446e-a424-e88887eca86d tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Getting quotas for project cd7b0d70fffe4d37a84bd4ee73d044ca. Resources: {'key_pairs'} {{(pid=129470) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 18:09:33.995545 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.quota [None req-8232d0c1-083e-446e-a424-e88887eca86d tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Getting quotas for user d1a7b2376e83489b87feb4b9fd449d55 and project cd7b0d70fffe4d37a84bd4ee73d044ca. Resources: {'key_pairs'} {{(pid=129470) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 18:09:34.018861 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-8232d0c1-083e-446e-a424-e88887eca86d tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045936 Jul 14 18:09:34.020263 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 574/1189] 10.222.0.64 () {60 vars in 1158 bytes} [Thu Jul 14 18:09:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:09:35.458660 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-fa86d9a5-b23f-4d16-acb4-f4a8ab3476bc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1323818249", "imageRef": "cf1f5d8c-9e49-4272-8e19-8e3c587056e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d836dc14-adcd-46d4-983c-5e81fdb4ff39"}], "security_groups": [{"name": "tempest-securitygroup--1081964383"}], "key_name": "tempest-keypair-1899848401", "user_data": "}} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:09:35.557999 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.network.neutron [None req-fa86d9a5-b23f-4d16-acb4-f4a8ab3476bc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] validate_networks() for [('d836dc14-adcd-46d4-983c-5e81fdb4ff39', None, None, None, None, None)] {{(pid=129471) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 18:09:35.993913 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-fa86d9a5-b23f-4d16-acb4-f4a8ab3476bc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Flavor limits 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 18:09:35.994370 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-fa86d9a5-b23f-4d16-acb4-f4a8ab3476bc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Image limits 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 18:09:35.994849 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-fa86d9a5-b23f-4d16-acb4-f4a8ab3476bc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Flavor pref 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 18:09:35.995297 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-fa86d9a5-b23f-4d16-acb4-f4a8ab3476bc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Image pref 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 18:09:35.995718 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-fa86d9a5-b23f-4d16-acb4-f4a8ab3476bc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 18:09:36.005098 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fa86d9a5-b23f-4d16-acb4-f4a8ab3476bc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:36.005556 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fa86d9a5-b23f-4d16-acb4-f4a8ab3476bc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:36.006366 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fa86d9a5-b23f-4d16-acb4-f4a8ab3476bc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:36.006808 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fa86d9a5-b23f-4d16-acb4-f4a8ab3476bc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:36.026842 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.quota [None req-fa86d9a5-b23f-4d16-acb4-f4a8ab3476bc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Getting quotas for project cd7b0d70fffe4d37a84bd4ee73d044ca. Resources: {'ram', 'cores', 'instances'} {{(pid=129471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 18:09:36.030945 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.quota [None req-fa86d9a5-b23f-4d16-acb4-f4a8ab3476bc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Getting quotas for user d1a7b2376e83489b87feb4b9fd449d55 and project cd7b0d70fffe4d37a84bd4ee73d044ca. Resources: {'ram', 'cores', 'instances'} {{(pid=129471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 18:09:36.042474 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-fa86d9a5-b23f-4d16-acb4-f4a8ab3476bc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Going to run 1 instances... {{(pid=129471) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 18:09:36.044875 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-fa86d9a5-b23f-4d16-acb4-f4a8ab3476bc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 75f3574e-e02b-459a-88a6-6bb7f2b43be4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf1f5d8c-9e49-4272-8e19-8e3c587056e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 18:09:36.094231 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-fa86d9a5-b23f-4d16-acb4-f4a8ab3476bc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.640876 Jul 14 18:09:36.095254 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 616/1190] 10.222.0.64 () {60 vars in 1146 bytes} [Thu Jul 14 18:09:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 18:09:36.105145 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-375338d7-644f-4fb1-a270-f2fdd29d1dab tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:09:36.105905 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-375338d7-644f-4fb1-a270-f2fdd29d1dab tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 75f3574e-e02b-459a-88a6-6bb7f2b43be4] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:09:36.163804 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-375338d7-644f-4fb1-a270-f2fdd29d1dab tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:09:36.174590 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-375338d7-644f-4fb1-a270-f2fdd29d1dab tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4" status: 200 len: 1242 microversion: 2.1 time: 0.073395 Jul 14 18:09:36.175157 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 575/1191] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:09:36 2022] GET /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4 => generated 1242 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 18:09:37.193442 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-7eab9a33-c3f6-46c5-b4b1-8879e036dc37 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:09:37.194004 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-7eab9a33-c3f6-46c5-b4b1-8879e036dc37 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 75f3574e-e02b-459a-88a6-6bb7f2b43be4] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:09:37.200579 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7eab9a33-c3f6-46c5-b4b1-8879e036dc37 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:37.201033 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7eab9a33-c3f6-46c5-b4b1-8879e036dc37 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:37.201853 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7eab9a33-c3f6-46c5-b4b1-8879e036dc37 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:37.202720 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7eab9a33-c3f6-46c5-b4b1-8879e036dc37 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:37.270830 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-7eab9a33-c3f6-46c5-b4b1-8879e036dc37 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:09:37.281157 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-7eab9a33-c3f6-46c5-b4b1-8879e036dc37 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4" status: 200 len: 1312 microversion: 2.1 time: 0.092846 Jul 14 18:09:37.281750 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 617/1192] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:09:37 2022] GET /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4 => generated 1312 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:09:38.298366 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-b0046467-b975-49e1-be08-ac4e4a7ba2b1 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:09:38.298973 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-b0046467-b975-49e1-be08-ac4e4a7ba2b1 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 75f3574e-e02b-459a-88a6-6bb7f2b43be4] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:09:38.305570 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b0046467-b975-49e1-be08-ac4e4a7ba2b1 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:38.306021 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b0046467-b975-49e1-be08-ac4e4a7ba2b1 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:38.306796 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b0046467-b975-49e1-be08-ac4e4a7ba2b1 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:38.307232 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b0046467-b975-49e1-be08-ac4e4a7ba2b1 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:38.463651 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-b0046467-b975-49e1-be08-ac4e4a7ba2b1 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:09:38.472644 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-b0046467-b975-49e1-be08-ac4e4a7ba2b1 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4" status: 200 len: 1368 microversion: 2.1 time: 0.177974 Jul 14 18:09:38.473249 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 576/1193] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:09:38 2022] GET /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4 => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:09:38.594285 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [req-405ac2d0-4835-447d-a380-0beb86a864d7 req-24bda319-7e2f-4b45-b043-cd2f0f50ac84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75f3574e-e02b-459a-88a6-6bb7f2b43be4", "tag": "b5a2f0d8-5684-4fdf-8425-0e43b5d0169d"}]} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:09:38.605249 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-405ac2d0-4835-447d-a380-0beb86a864d7 req-24bda319-7e2f-4b45-b043-cd2f0f50ac84 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:38.606490 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-405ac2d0-4835-447d-a380-0beb86a864d7 req-24bda319-7e2f-4b45-b043-cd2f0f50ac84 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:38.621956 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.compute.server_external_events [req-405ac2d0-4835-447d-a380-0beb86a864d7 req-24bda319-7e2f-4b45-b043-cd2f0f50ac84 service nova] Creating event network-changed:b5a2f0d8-5684-4fdf-8425-0e43b5d0169d for instance 75f3574e-e02b-459a-88a6-6bb7f2b43be4 on hv-cinder-84989 Jul 14 18:09:38.627887 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [req-405ac2d0-4835-447d-a380-0beb86a864d7 req-24bda319-7e2f-4b45-b043-cd2f0f50ac84 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037311 Jul 14 18:09:38.631219 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 618/1194] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 18:09:39.490754 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-b0eda53d-168f-498c-970f-1e1fc2a84b90 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:09:39.491366 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-b0eda53d-168f-498c-970f-1e1fc2a84b90 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 75f3574e-e02b-459a-88a6-6bb7f2b43be4] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:09:39.497931 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b0eda53d-168f-498c-970f-1e1fc2a84b90 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:39.498378 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b0eda53d-168f-498c-970f-1e1fc2a84b90 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:39.499179 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b0eda53d-168f-498c-970f-1e1fc2a84b90 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:39.499618 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b0eda53d-168f-498c-970f-1e1fc2a84b90 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:39.625421 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-b0eda53d-168f-498c-970f-1e1fc2a84b90 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:09:39.632839 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-b0eda53d-168f-498c-970f-1e1fc2a84b90 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4" status: 200 len: 1368 microversion: 2.1 time: 0.146807 Jul 14 18:09:39.633400 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 577/1195] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:09:39 2022] GET /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:09:40.650070 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-558c993c-833a-43d5-9dd6-55e6ca6f89d1 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:09:40.650782 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-558c993c-833a-43d5-9dd6-55e6ca6f89d1 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 75f3574e-e02b-459a-88a6-6bb7f2b43be4] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:09:40.657654 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-558c993c-833a-43d5-9dd6-55e6ca6f89d1 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:40.658187 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-558c993c-833a-43d5-9dd6-55e6ca6f89d1 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:40.658881 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-558c993c-833a-43d5-9dd6-55e6ca6f89d1 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:40.659324 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-558c993c-833a-43d5-9dd6-55e6ca6f89d1 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:40.787103 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-558c993c-833a-43d5-9dd6-55e6ca6f89d1 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:09:40.794796 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-558c993c-833a-43d5-9dd6-55e6ca6f89d1 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4" status: 200 len: 1368 microversion: 2.1 time: 0.148962 Jul 14 18:09:40.795368 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 619/1196] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:09:40 2022] GET /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:09:41.819126 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-9f28efa6-9f4d-4aec-ac86-298af5ce9219 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:09:41.819744 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-9f28efa6-9f4d-4aec-ac86-298af5ce9219 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 75f3574e-e02b-459a-88a6-6bb7f2b43be4] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:09:41.826266 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9f28efa6-9f4d-4aec-ac86-298af5ce9219 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:41.826720 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9f28efa6-9f4d-4aec-ac86-298af5ce9219 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:41.827501 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9f28efa6-9f4d-4aec-ac86-298af5ce9219 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:41.827977 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9f28efa6-9f4d-4aec-ac86-298af5ce9219 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:41.960345 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-9f28efa6-9f4d-4aec-ac86-298af5ce9219 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:09:41.967769 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-9f28efa6-9f4d-4aec-ac86-298af5ce9219 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4" status: 200 len: 1368 microversion: 2.1 time: 0.153304 Jul 14 18:09:41.968379 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 578/1197] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:09:41 2022] GET /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:09:42.984826 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-807770b5-7129-40b7-8197-0b0c3840eccd tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:09:42.985445 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-807770b5-7129-40b7-8197-0b0c3840eccd tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 75f3574e-e02b-459a-88a6-6bb7f2b43be4] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:09:42.991996 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-807770b5-7129-40b7-8197-0b0c3840eccd tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:42.992453 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-807770b5-7129-40b7-8197-0b0c3840eccd tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:42.993715 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-807770b5-7129-40b7-8197-0b0c3840eccd tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:42.993715 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-807770b5-7129-40b7-8197-0b0c3840eccd tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:43.120324 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-807770b5-7129-40b7-8197-0b0c3840eccd tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:09:43.128340 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-807770b5-7129-40b7-8197-0b0c3840eccd tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4" status: 200 len: 1368 microversion: 2.1 time: 0.146837 Jul 14 18:09:43.128904 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 620/1198] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:09:42 2022] GET /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:09:44.145247 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-afa88e86-fa53-48a4-afb3-b5e2dce74235 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:09:44.145864 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-afa88e86-fa53-48a4-afb3-b5e2dce74235 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 75f3574e-e02b-459a-88a6-6bb7f2b43be4] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:09:44.152609 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-afa88e86-fa53-48a4-afb3-b5e2dce74235 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:44.153073 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-afa88e86-fa53-48a4-afb3-b5e2dce74235 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:44.153859 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-afa88e86-fa53-48a4-afb3-b5e2dce74235 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:44.154304 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-afa88e86-fa53-48a4-afb3-b5e2dce74235 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:44.272421 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [req-1d9ad21b-b2d2-4bb1-a22e-15023004cc21 req-680333e3-6716-4ec8-bfb4-b7826d784580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75f3574e-e02b-459a-88a6-6bb7f2b43be4", "name": "network-vif-plugged", "status": "completed", "tag": "b5a2f0d8-5684-4fdf-8425-0e43b5d0169d"}]} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:09:44.280813 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-1d9ad21b-b2d2-4bb1-a22e-15023004cc21 req-680333e3-6716-4ec8-bfb4-b7826d784580 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:44.281261 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-1d9ad21b-b2d2-4bb1-a22e-15023004cc21 req-680333e3-6716-4ec8-bfb4-b7826d784580 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:44.293190 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.compute.server_external_events [req-1d9ad21b-b2d2-4bb1-a22e-15023004cc21 req-680333e3-6716-4ec8-bfb4-b7826d784580 service nova] Creating event network-vif-plugged:b5a2f0d8-5684-4fdf-8425-0e43b5d0169d for instance 75f3574e-e02b-459a-88a6-6bb7f2b43be4 on hv-cinder-84989 Jul 14 18:09:44.295571 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-afa88e86-fa53-48a4-afb3-b5e2dce74235 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:09:44.298295 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [req-1d9ad21b-b2d2-4bb1-a22e-15023004cc21 req-680333e3-6716-4ec8-bfb4-b7826d784580 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091437 Jul 14 18:09:44.298907 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 621/1199] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:09:44.304251 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-afa88e86-fa53-48a4-afb3-b5e2dce74235 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4" status: 200 len: 1368 microversion: 2.1 time: 0.163359 Jul 14 18:09:44.304821 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 579/1200] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:09:44 2022] GET /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:09:45.322413 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-752ec441-12b5-4588-9be4-f4a9e7f43e2c tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:09:45.323111 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-752ec441-12b5-4588-9be4-f4a9e7f43e2c tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 75f3574e-e02b-459a-88a6-6bb7f2b43be4] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:09:45.329361 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-752ec441-12b5-4588-9be4-f4a9e7f43e2c tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:45.329793 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-752ec441-12b5-4588-9be4-f4a9e7f43e2c tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:45.330548 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-752ec441-12b5-4588-9be4-f4a9e7f43e2c tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:45.331618 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-752ec441-12b5-4588-9be4-f4a9e7f43e2c tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:45.468286 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-752ec441-12b5-4588-9be4-f4a9e7f43e2c tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:09:45.475873 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-752ec441-12b5-4588-9be4-f4a9e7f43e2c tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4" status: 200 len: 1368 microversion: 2.1 time: 0.158121 Jul 14 18:09:45.476465 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 622/1201] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:09:45 2022] GET /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:09:46.492607 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-a0221159-2422-4bdf-a2a3-699718fb19fd tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:09:46.493222 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-a0221159-2422-4bdf-a2a3-699718fb19fd tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 75f3574e-e02b-459a-88a6-6bb7f2b43be4] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:09:46.495639 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell0:SELECT=6 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:09:46.501293 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a0221159-2422-4bdf-a2a3-699718fb19fd tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:46.501745 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a0221159-2422-4bdf-a2a3-699718fb19fd tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:46.502517 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a0221159-2422-4bdf-a2a3-699718fb19fd tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:46.502950 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a0221159-2422-4bdf-a2a3-699718fb19fd tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:46.634630 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-a0221159-2422-4bdf-a2a3-699718fb19fd tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:09:46.642181 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-a0221159-2422-4bdf-a2a3-699718fb19fd tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4" status: 200 len: 1558 microversion: 2.1 time: 0.153413 Jul 14 18:09:46.642746 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 580/1202] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:09:46 2022] GET /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:09:46.660020 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-38665ae8-445f-41c2-9e9c-8e38436fdffa tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:09:46.660530 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-38665ae8-445f-41c2-9e9c-8e38436fdffa tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 75f3574e-e02b-459a-88a6-6bb7f2b43be4] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:09:46.662446 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell0:SELECT=2 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:09:46.663137 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell0:SELECT=6 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:09:46.670272 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-38665ae8-445f-41c2-9e9c-8e38436fdffa tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:46.670730 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-38665ae8-445f-41c2-9e9c-8e38436fdffa tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:46.671540 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-38665ae8-445f-41c2-9e9c-8e38436fdffa tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:46.672005 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-38665ae8-445f-41c2-9e9c-8e38436fdffa tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:46.750112 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-38665ae8-445f-41c2-9e9c-8e38436fdffa tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094304 Jul 14 18:09:46.750973 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 623/1203] 10.222.0.64 () {58 vars in 1274 bytes} [Thu Jul 14 18:09:46 2022] GET /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:09:47.668693 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-e92bfa5c-48e5-4866-bbcb-fe7f4a1db504 req-f2ea3643-aa3c-434c-aede-acb600b9e5e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75f3574e-e02b-459a-88a6-6bb7f2b43be4", "tag": "b5a2f0d8-5684-4fdf-8425-0e43b5d0169d"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:09:47.677650 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-e92bfa5c-48e5-4866-bbcb-fe7f4a1db504 req-f2ea3643-aa3c-434c-aede-acb600b9e5e9 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:09:47.678183 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-e92bfa5c-48e5-4866-bbcb-fe7f4a1db504 req-f2ea3643-aa3c-434c-aede-acb600b9e5e9 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:09:47.689194 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-e92bfa5c-48e5-4866-bbcb-fe7f4a1db504 req-f2ea3643-aa3c-434c-aede-acb600b9e5e9 service nova] Creating event network-changed:b5a2f0d8-5684-4fdf-8425-0e43b5d0169d for instance 75f3574e-e02b-459a-88a6-6bb7f2b43be4 on hv-cinder-84989 Jul 14 18:09:47.694791 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-e92bfa5c-48e5-4866-bbcb-fe7f4a1db504 req-f2ea3643-aa3c-434c-aede-acb600b9e5e9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030053 Jul 14 18:09:47.695681 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 581/1204] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:10:38.592504 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 18:10:38.593227 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Thu Jul 14 18:10:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 18:11:12.489736 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:11:12.490629 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:11:12.494841 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-28c7a474-0d97-4b23-ab70-9005e2ccae6a tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:11:12.495335 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-28c7a474-0d97-4b23-ab70-9005e2ccae6a tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 75f3574e-e02b-459a-88a6-6bb7f2b43be4] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:11:12.509138 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-28c7a474-0d97-4b23-ab70-9005e2ccae6a tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:11:12.509608 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-28c7a474-0d97-4b23-ab70-9005e2ccae6a tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:11:12.510399 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-28c7a474-0d97-4b23-ab70-9005e2ccae6a tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:11:12.510833 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-28c7a474-0d97-4b23-ab70-9005e2ccae6a tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:11:12.539082 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-28c7a474-0d97-4b23-ab70-9005e2ccae6a tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4/ips" status: 200 len: 149 microversion: 2.1 time: 0.051131 Jul 14 18:11:12.539643 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 624/1205] 10.222.0.64 () {58 vars in 1247 bytes} [Thu Jul 14 18:11:12 2022] GET /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4/ips => generated 149 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:11:13.867667 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:11:13.868909 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:11:13.873808 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-fa41f803-faa6-4740-a782-c930a06fe225 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "410a849d-8211-4a7d-97ea-b45868667540"}} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:11:13.875047 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-fa41f803-faa6-4740-a782-c930a06fe225 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 75f3574e-e02b-459a-88a6-6bb7f2b43be4] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:11:13.883953 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fa41f803-faa6-4740-a782-c930a06fe225 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:11:13.884427 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fa41f803-faa6-4740-a782-c930a06fe225 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:11:13.885238 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fa41f803-faa6-4740-a782-c930a06fe225 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:11:13.885673 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fa41f803-faa6-4740-a782-c930a06fe225 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:11:14.155143 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-fa41f803-faa6-4740-a782-c930a06fe225 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "POST /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289317 Jul 14 18:11:14.156033 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 582/1206] 10.222.0.64 () {60 vars in 1322 bytes} [Thu Jul 14 18:11:13 2022] POST /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:11:21.768529 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-0e1bfcc6-a8cc-47b2-b148-56c0b1e345fe tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:11:21.769133 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-0e1bfcc6-a8cc-47b2-b148-56c0b1e345fe tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 75f3574e-e02b-459a-88a6-6bb7f2b43be4] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:11:21.776199 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0e1bfcc6-a8cc-47b2-b148-56c0b1e345fe tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:11:21.776747 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0e1bfcc6-a8cc-47b2-b148-56c0b1e345fe tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:11:21.777443 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0e1bfcc6-a8cc-47b2-b148-56c0b1e345fe tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:11:21.777876 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0e1bfcc6-a8cc-47b2-b148-56c0b1e345fe tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:11:21.862442 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.objects.instance [None req-0e1bfcc6-a8cc-47b2-b148-56c0b1e345fe tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lazy-loading 'services' on Instance uuid 75f3574e-e02b-459a-88a6-6bb7f2b43be4 {{(pid=129471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 18:11:21.939975 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-0e1bfcc6-a8cc-47b2-b148-56c0b1e345fe tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "DELETE /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4/os-volume_attachments/410a849d-8211-4a7d-97ea-b45868667540" status: 202 len: 0 microversion: 2.1 time: 0.175456 Jul 14 18:11:21.940580 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 625/1207] 10.222.0.64 () {58 vars in 1415 bytes} [Thu Jul 14 18:11:21 2022] DELETE /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4/os-volume_attachments/410a849d-8211-4a7d-97ea-b45868667540 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 18:11:21.949946 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-56031fa2-3fcc-4b12-ac30-564411277ebf tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:11:21.950981 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-56031fa2-3fcc-4b12-ac30-564411277ebf tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 75f3574e-e02b-459a-88a6-6bb7f2b43be4] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:11:21.958342 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-56031fa2-3fcc-4b12-ac30-564411277ebf tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:11:21.958807 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-56031fa2-3fcc-4b12-ac30-564411277ebf tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:11:21.959663 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-56031fa2-3fcc-4b12-ac30-564411277ebf tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:11:21.960189 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-56031fa2-3fcc-4b12-ac30-564411277ebf tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:11:21.991029 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-56031fa2-3fcc-4b12-ac30-564411277ebf tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045797 Jul 14 18:11:21.991606 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 583/1208] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Jul 14 18:11:21 2022] GET /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 18:11:23.004202 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-1749f507-000a-435a-83aa-0d15626b977e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:11:23.005191 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-1749f507-000a-435a-83aa-0d15626b977e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 75f3574e-e02b-459a-88a6-6bb7f2b43be4] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:11:23.011540 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1749f507-000a-435a-83aa-0d15626b977e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:11:23.012024 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1749f507-000a-435a-83aa-0d15626b977e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:11:23.012801 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1749f507-000a-435a-83aa-0d15626b977e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:11:23.013246 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-1749f507-000a-435a-83aa-0d15626b977e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:11:23.043738 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-1749f507-000a-435a-83aa-0d15626b977e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044582 Jul 14 18:11:23.044354 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 626/1209] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Jul 14 18:11:22 2022] GET /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 18:11:23.102352 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-f0a48459-27da-4a75-ae4b-32a53fcb2535 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:11:23.102928 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-f0a48459-27da-4a75-ae4b-32a53fcb2535 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 75f3574e-e02b-459a-88a6-6bb7f2b43be4] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:11:23.109362 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f0a48459-27da-4a75-ae4b-32a53fcb2535 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:11:23.109811 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f0a48459-27da-4a75-ae4b-32a53fcb2535 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:11:23.110581 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f0a48459-27da-4a75-ae4b-32a53fcb2535 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:11:23.111026 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-f0a48459-27da-4a75-ae4b-32a53fcb2535 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:11:23.135909 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-f0a48459-27da-4a75-ae4b-32a53fcb2535 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 75f3574e-e02b-459a-88a6-6bb7f2b43be4] Going to try to terminate instance {{(pid=129470) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 18:11:23.211516 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-f0a48459-27da-4a75-ae4b-32a53fcb2535 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "DELETE /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4" status: 204 len: 0 microversion: 2.1 time: 0.112896 Jul 14 18:11:23.215213 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 584/1210] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Jul 14 18:11:23 2022] DELETE /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 18:11:23.221247 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-663b04bb-8c50-4c05-8f90-e8f74fe00937 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:11:23.221873 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-663b04bb-8c50-4c05-8f90-e8f74fe00937 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 75f3574e-e02b-459a-88a6-6bb7f2b43be4] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:11:23.228004 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-663b04bb-8c50-4c05-8f90-e8f74fe00937 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:11:23.228467 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-663b04bb-8c50-4c05-8f90-e8f74fe00937 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:11:23.229272 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-663b04bb-8c50-4c05-8f90-e8f74fe00937 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:11:23.229700 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-663b04bb-8c50-4c05-8f90-e8f74fe00937 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:11:23.380194 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-663b04bb-8c50-4c05-8f90-e8f74fe00937 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:11:23.386030 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-663b04bb-8c50-4c05-8f90-e8f74fe00937 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4" status: 200 len: 1682 microversion: 2.1 time: 0.169458 Jul 14 18:11:23.386619 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 627/1211] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:11:23 2022] GET /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 18:11:24.413901 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-7e2ccbe9-6ec3-47f0-9c98-95115695732e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:11:24.414626 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-7e2ccbe9-6ec3-47f0-9c98-95115695732e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 75f3574e-e02b-459a-88a6-6bb7f2b43be4] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:11:24.421768 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7e2ccbe9-6ec3-47f0-9c98-95115695732e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:11:24.422218 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7e2ccbe9-6ec3-47f0-9c98-95115695732e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:11:24.423016 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7e2ccbe9-6ec3-47f0-9c98-95115695732e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:11:24.423458 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7e2ccbe9-6ec3-47f0-9c98-95115695732e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:11:24.557579 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-7e2ccbe9-6ec3-47f0-9c98-95115695732e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:11:24.565322 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-7e2ccbe9-6ec3-47f0-9c98-95115695732e tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4" status: 200 len: 1682 microversion: 2.1 time: 0.155802 Jul 14 18:11:24.565905 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 585/1212] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:11:24 2022] GET /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 18:11:25.585441 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-7e80ec3b-c4a8-4c52-bdb2-b0a380456450 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:11:25.586174 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-7e80ec3b-c4a8-4c52-bdb2-b0a380456450 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 75f3574e-e02b-459a-88a6-6bb7f2b43be4] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:11:25.593437 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7e80ec3b-c4a8-4c52-bdb2-b0a380456450 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:11:25.593943 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7e80ec3b-c4a8-4c52-bdb2-b0a380456450 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:11:25.594797 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7e80ec3b-c4a8-4c52-bdb2-b0a380456450 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:11:25.595722 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7e80ec3b-c4a8-4c52-bdb2-b0a380456450 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:11:25.658864 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-7e80ec3b-c4a8-4c52-bdb2-b0a380456450 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a7b2376e83489b87feb4b9fd449d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7b0d70fffe4d37a84bd4ee73d044ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:11:25.666392 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-7e80ec3b-c4a8-4c52-bdb2-b0a380456450 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4" status: 200 len: 1614 microversion: 2.1 time: 0.087667 Jul 14 18:11:25.667288 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 628/1213] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:11:25 2022] GET /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4 => generated 1614 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:11:25.982170 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-45dbf5d5-1a7c-4c63-bcfc-f626f5335806 req-f2a9c0bf-3a53-4117-8e70-82721fc8163b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75f3574e-e02b-459a-88a6-6bb7f2b43be4", "name": "network-vif-deleted", "tag": "b5a2f0d8-5684-4fdf-8425-0e43b5d0169d"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:11:25.994958 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-45dbf5d5-1a7c-4c63-bcfc-f626f5335806 req-f2a9c0bf-3a53-4117-8e70-82721fc8163b service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:11:25.995766 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-45dbf5d5-1a7c-4c63-bcfc-f626f5335806 req-f2a9c0bf-3a53-4117-8e70-82721fc8163b service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:11:26.009781 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-45dbf5d5-1a7c-4c63-bcfc-f626f5335806 req-f2a9c0bf-3a53-4117-8e70-82721fc8163b service nova] Creating event network-vif-deleted:b5a2f0d8-5684-4fdf-8425-0e43b5d0169d for instance 75f3574e-e02b-459a-88a6-6bb7f2b43be4 on hv-cinder-84989 Jul 14 18:11:26.016341 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-45dbf5d5-1a7c-4c63-bcfc-f626f5335806 req-f2a9c0bf-3a53-4117-8e70-82721fc8163b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150117 Jul 14 18:11:26.017639 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 586/1214] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:11:26.684680 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-fa047557-04d8-4ae9-b9b1-08ba82f5f14a tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:11:26.685400 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-fa047557-04d8-4ae9-b9b1-08ba82f5f14a tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 75f3574e-e02b-459a-88a6-6bb7f2b43be4] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:11:26.692435 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fa047557-04d8-4ae9-b9b1-08ba82f5f14a tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:11:26.693032 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fa047557-04d8-4ae9-b9b1-08ba82f5f14a tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:11:26.694066 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fa047557-04d8-4ae9-b9b1-08ba82f5f14a tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:11:26.694237 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fa047557-04d8-4ae9-b9b1-08ba82f5f14a tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:11:26.708696 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.wsgi [None req-fa047557-04d8-4ae9-b9b1-08ba82f5f14a tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] HTTP exception thrown: Instance 75f3574e-e02b-459a-88a6-6bb7f2b43be4 could not be found. Jul 14 18:11:26.710365 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-fa047557-04d8-4ae9-b9b1-08ba82f5f14a tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Request method failure captured: Jul 14 18:11:26.710365 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: request: GET /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4 HTTP/1.1 Jul 14 18:11:26.710365 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept: application/json Jul 14 18:11:26.710365 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept-Encoding: identity Jul 14 18:11:26.710365 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Connection: close Jul 14 18:11:26.710365 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Length: 0 Jul 14 18:11:26.710365 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Type: application/json Jul 14 18:11:26.710365 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Host: 10.222.0.64 Jul 14 18:11:26.710365 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Openstack-System-Scope: None Jul 14 18:11:26.710365 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: User-Agent: python-urllib3/1.26.9 Jul 14 18:11:26.710365 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Auth-Token: gAAAAABi0FqQJwSdeIlyvTJTebGB2HswWMQXdEeVQ1nqnsr0mN7imW5yYBtB7v0AYBUvhZx3ERaakjDBC-y17nbWzPHdLShTJjvjoOWOEu2O2dHU4WvbtqYTFlYdN2M2cROj3RwdhDe-fwWgM_ya_OxtW44tU56VzqdTH9IrVrscBvrZes_8UeI Jul 14 18:11:26.710365 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Id: None Jul 14 18:11:26.710365 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Name: None Jul 14 18:11:26.710365 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Identity-Status: Confirmed Jul 14 18:11:26.710365 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Is-Admin-Project: True Jul 14 18:11:26.710365 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Id: default Jul 14 18:11:26.710365 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Name: Default Jul 14 18:11:26.710365 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Id: cd7b0d70fffe4d37a84bd4ee73d044ca Jul 14 18:11:26.710365 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Name: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:11:26.710365 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Role: reader,member Jul 14 18:11:26.710365 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Roles: reader,member Jul 14 18:11:26.712155 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cd7b0d70fffe4d37a84bd4ee73d044ca", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:11:26.712155 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:11:26.712155 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Id: cd7b0d70fffe4d37a84bd4ee73d044ca Jul 14 18:11:26.712155 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:11:26.712155 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User: tempest-AttachVolumeNegativeTest-775141180-project Jul 14 18:11:26.712155 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Id: default Jul 14 18:11:26.712155 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Name: Default Jul 14 18:11:26.712155 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Id: d1a7b2376e83489b87feb4b9fd449d55 Jul 14 18:11:26.712155 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Name: tempest-AttachVolumeNegativeTest-775141180-project Jul 14 18:11:26.712155 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: method: > Jul 14 18:11:26.712155 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: exception: Instance 75f3574e-e02b-459a-88a6-6bb7f2b43be4 could not be found. Jul 14 18:11:26.712155 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: action_args: {'id': '75f3574e-e02b-459a-88a6-6bb7f2b43be4'} Jul 14 18:11:26.713165 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:11:26.713165 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:11:26.713165 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 18:11:26.713165 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 18:11:26.713165 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 18:11:26.713165 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 18:11:26.713165 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 18:11:26.713165 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 18:11:26.713165 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 18:11:26.713165 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 18:11:26.713165 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75f3574e-e02b-459a-88a6-6bb7f2b43be4 could not be found. Jul 14 18:11:26.713165 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:11:26.713165 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:11:26.713165 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:11:26.713165 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:11:26.713165 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:11:26.713165 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:11:26.713165 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:11:26.713165 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:11:26.713165 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:11:26.714873 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:11:26.714873 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 18:11:26.714873 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 18:11:26.714873 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 18:11:26.714873 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 18:11:26.714873 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 18:11:26.714873 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 18:11:26.714873 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75f3574e-e02b-459a-88a6-6bb7f2b43be4 could not be found. Jul 14 18:11:26.714873 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:11:26.714873 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:11:26.714873 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:11:26.714873 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:11:26.714873 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:11:26.714873 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:11:26.714873 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 18:11:26.714873 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 18:11:26.714873 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75f3574e-e02b-459a-88a6-6bb7f2b43be4 could not be found. Jul 14 18:11:26.714873 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:11:26.716415 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-fa047557-04d8-4ae9-b9b1-08ba82f5f14a tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Returning 404 to user: Instance 75f3574e-e02b-459a-88a6-6bb7f2b43be4 could not be found. {{(pid=129471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:11:26.716415 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-fa047557-04d8-4ae9-b9b1-08ba82f5f14a tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4" status: 404 len: 111 microversion: 2.1 time: 0.031842 Jul 14 18:11:26.716415 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 629/1215] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:11:26 2022] GET /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 18:11:26.722845 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-7251304e-bb17-48f3-b91b-95c295faf7cf tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '.version_select at 0x7f1380238d30>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:11:26.739733 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-7251304e-bb17-48f3-b91b-95c295faf7cf tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1899848401" status: 202 len: 0 microversion: 2.1 time: 0.021699 Jul 14 18:11:26.740335 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 587/1216] 10.222.0.64 () {58 vars in 1220 bytes} [Thu Jul 14 18:11:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1899848401 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 18:11:28.506368 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-51f61417-5120-4292-9cba-5ffb8ce54680 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:11:28.506856 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-51f61417-5120-4292-9cba-5ffb8ce54680 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 75f3574e-e02b-459a-88a6-6bb7f2b43be4] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:11:28.513250 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-51f61417-5120-4292-9cba-5ffb8ce54680 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:11:28.513695 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-51f61417-5120-4292-9cba-5ffb8ce54680 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:11:28.514447 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-51f61417-5120-4292-9cba-5ffb8ce54680 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:11:28.514912 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-51f61417-5120-4292-9cba-5ffb8ce54680 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:11:28.528032 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.wsgi [None req-51f61417-5120-4292-9cba-5ffb8ce54680 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] HTTP exception thrown: Instance 75f3574e-e02b-459a-88a6-6bb7f2b43be4 could not be found. Jul 14 18:11:28.529569 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-51f61417-5120-4292-9cba-5ffb8ce54680 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Request method failure captured: Jul 14 18:11:28.529569 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: request: DELETE /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4 HTTP/1.1 Jul 14 18:11:28.529569 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept: application/json Jul 14 18:11:28.529569 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept-Encoding: identity Jul 14 18:11:28.529569 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Connection: close Jul 14 18:11:28.529569 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Length: 0 Jul 14 18:11:28.529569 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Type: application/json Jul 14 18:11:28.529569 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Host: 10.222.0.64 Jul 14 18:11:28.529569 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Openstack-System-Scope: None Jul 14 18:11:28.529569 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: User-Agent: python-urllib3/1.26.9 Jul 14 18:11:28.529569 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Auth-Token: gAAAAABi0FqQJwSdeIlyvTJTebGB2HswWMQXdEeVQ1nqnsr0mN7imW5yYBtB7v0AYBUvhZx3ERaakjDBC-y17nbWzPHdLShTJjvjoOWOEu2O2dHU4WvbtqYTFlYdN2M2cROj3RwdhDe-fwWgM_ya_OxtW44tU56VzqdTH9IrVrscBvrZes_8UeI Jul 14 18:11:28.529569 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Id: None Jul 14 18:11:28.529569 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Name: None Jul 14 18:11:28.529569 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Identity-Status: Confirmed Jul 14 18:11:28.529569 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Is-Admin-Project: True Jul 14 18:11:28.529569 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Id: default Jul 14 18:11:28.529569 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Name: Default Jul 14 18:11:28.529569 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Id: cd7b0d70fffe4d37a84bd4ee73d044ca Jul 14 18:11:28.529569 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Name: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:11:28.529569 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Role: reader,member Jul 14 18:11:28.529569 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Roles: reader,member Jul 14 18:11:28.531318 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cd7b0d70fffe4d37a84bd4ee73d044ca", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:11:28.531318 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:11:28.531318 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Id: cd7b0d70fffe4d37a84bd4ee73d044ca Jul 14 18:11:28.531318 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:11:28.531318 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User: tempest-AttachVolumeNegativeTest-775141180-project Jul 14 18:11:28.531318 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Id: default Jul 14 18:11:28.531318 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Name: Default Jul 14 18:11:28.531318 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Id: d1a7b2376e83489b87feb4b9fd449d55 Jul 14 18:11:28.531318 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Name: tempest-AttachVolumeNegativeTest-775141180-project Jul 14 18:11:28.531318 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: method: > Jul 14 18:11:28.531318 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: exception: Instance 75f3574e-e02b-459a-88a6-6bb7f2b43be4 could not be found. Jul 14 18:11:28.531318 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: action_args: {'id': '75f3574e-e02b-459a-88a6-6bb7f2b43be4'} Jul 14 18:11:28.532348 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:11:28.532348 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:11:28.532348 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 18:11:28.532348 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 18:11:28.532348 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 18:11:28.532348 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 18:11:28.532348 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 18:11:28.532348 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 18:11:28.532348 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 18:11:28.532348 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 18:11:28.532348 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75f3574e-e02b-459a-88a6-6bb7f2b43be4 could not be found. Jul 14 18:11:28.532348 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:11:28.532348 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:11:28.532348 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:11:28.532348 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:11:28.532348 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:11:28.532348 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:11:28.532348 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:11:28.532348 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:11:28.532348 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:11:28.534486 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:11:28.534486 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 18:11:28.534486 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 18:11:28.534486 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 18:11:28.534486 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 18:11:28.534486 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 18:11:28.534486 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 18:11:28.534486 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 18:11:28.534486 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 18:11:28.534486 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75f3574e-e02b-459a-88a6-6bb7f2b43be4 could not be found. Jul 14 18:11:28.534486 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:11:28.534486 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:11:28.534486 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:11:28.534486 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:11:28.534486 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:11:28.534486 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:11:28.534486 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 18:11:28.534486 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 18:11:28.534486 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75f3574e-e02b-459a-88a6-6bb7f2b43be4 could not be found. Jul 14 18:11:28.534486 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:11:28.536093 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-51f61417-5120-4292-9cba-5ffb8ce54680 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Returning 404 to user: Instance 75f3574e-e02b-459a-88a6-6bb7f2b43be4 could not be found. {{(pid=129471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:11:28.536093 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-51f61417-5120-4292-9cba-5ffb8ce54680 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "DELETE /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4" status: 404 len: 111 microversion: 2.1 time: 0.028386 Jul 14 18:11:28.536093 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 630/1217] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Jul 14 18:11:28 2022] DELETE /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 18:11:28.540430 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-5d425b4c-643e-41d2-a083-d037c9ae4ed3 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:11:28.541159 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-5d425b4c-643e-41d2-a083-d037c9ae4ed3 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 75f3574e-e02b-459a-88a6-6bb7f2b43be4] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:11:28.547231 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5d425b4c-643e-41d2-a083-d037c9ae4ed3 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:11:28.547677 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5d425b4c-643e-41d2-a083-d037c9ae4ed3 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:11:28.549177 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5d425b4c-643e-41d2-a083-d037c9ae4ed3 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:11:28.549611 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5d425b4c-643e-41d2-a083-d037c9ae4ed3 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:11:28.565379 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.wsgi [None req-5d425b4c-643e-41d2-a083-d037c9ae4ed3 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] HTTP exception thrown: Instance 75f3574e-e02b-459a-88a6-6bb7f2b43be4 could not be found. Jul 14 18:11:28.567020 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-5d425b4c-643e-41d2-a083-d037c9ae4ed3 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Request method failure captured: Jul 14 18:11:28.567020 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: request: GET /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4 HTTP/1.1 Jul 14 18:11:28.567020 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept: application/json Jul 14 18:11:28.567020 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept-Encoding: identity Jul 14 18:11:28.567020 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Connection: close Jul 14 18:11:28.567020 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Length: 0 Jul 14 18:11:28.567020 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Type: application/json Jul 14 18:11:28.567020 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Host: 10.222.0.64 Jul 14 18:11:28.567020 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Openstack-System-Scope: None Jul 14 18:11:28.567020 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: User-Agent: python-urllib3/1.26.9 Jul 14 18:11:28.567020 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Auth-Token: gAAAAABi0FqQJwSdeIlyvTJTebGB2HswWMQXdEeVQ1nqnsr0mN7imW5yYBtB7v0AYBUvhZx3ERaakjDBC-y17nbWzPHdLShTJjvjoOWOEu2O2dHU4WvbtqYTFlYdN2M2cROj3RwdhDe-fwWgM_ya_OxtW44tU56VzqdTH9IrVrscBvrZes_8UeI Jul 14 18:11:28.567020 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Id: None Jul 14 18:11:28.567020 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Name: None Jul 14 18:11:28.567020 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Identity-Status: Confirmed Jul 14 18:11:28.567020 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Is-Admin-Project: True Jul 14 18:11:28.567020 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Id: default Jul 14 18:11:28.567020 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Name: Default Jul 14 18:11:28.567020 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Id: cd7b0d70fffe4d37a84bd4ee73d044ca Jul 14 18:11:28.567020 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Name: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:11:28.567020 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Role: reader,member Jul 14 18:11:28.567020 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Roles: reader,member Jul 14 18:11:28.568685 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cd7b0d70fffe4d37a84bd4ee73d044ca", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:11:28.568685 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:11:28.568685 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Id: cd7b0d70fffe4d37a84bd4ee73d044ca Jul 14 18:11:28.568685 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:11:28.568685 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User: tempest-AttachVolumeNegativeTest-775141180-project Jul 14 18:11:28.568685 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Id: default Jul 14 18:11:28.568685 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Name: Default Jul 14 18:11:28.568685 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Id: d1a7b2376e83489b87feb4b9fd449d55 Jul 14 18:11:28.568685 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Name: tempest-AttachVolumeNegativeTest-775141180-project Jul 14 18:11:28.568685 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: method: > Jul 14 18:11:28.568685 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: exception: Instance 75f3574e-e02b-459a-88a6-6bb7f2b43be4 could not be found. Jul 14 18:11:28.568685 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: action_args: {'id': '75f3574e-e02b-459a-88a6-6bb7f2b43be4'} Jul 14 18:11:28.569620 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:11:28.569620 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:11:28.569620 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 18:11:28.569620 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 18:11:28.569620 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 18:11:28.569620 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 18:11:28.569620 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 18:11:28.569620 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 18:11:28.569620 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 18:11:28.569620 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 18:11:28.569620 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75f3574e-e02b-459a-88a6-6bb7f2b43be4 could not be found. Jul 14 18:11:28.569620 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:11:28.569620 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:11:28.569620 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:11:28.569620 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:11:28.569620 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:11:28.569620 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:11:28.569620 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:11:28.569620 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:11:28.569620 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:11:28.571153 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:11:28.571153 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 18:11:28.571153 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 18:11:28.571153 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 18:11:28.571153 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 18:11:28.571153 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 18:11:28.571153 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 18:11:28.571153 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75f3574e-e02b-459a-88a6-6bb7f2b43be4 could not be found. Jul 14 18:11:28.571153 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:11:28.571153 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:11:28.571153 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:11:28.571153 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:11:28.571153 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:11:28.571153 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:11:28.571153 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 18:11:28.571153 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 18:11:28.571153 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75f3574e-e02b-459a-88a6-6bb7f2b43be4 could not be found. Jul 14 18:11:28.571153 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:11:28.572589 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-5d425b4c-643e-41d2-a083-d037c9ae4ed3 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Returning 404 to user: Instance 75f3574e-e02b-459a-88a6-6bb7f2b43be4 could not be found. {{(pid=129470) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:11:28.572589 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-5d425b4c-643e-41d2-a083-d037c9ae4ed3 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4" status: 404 len: 111 microversion: 2.1 time: 0.032345 Jul 14 18:11:28.572589 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 588/1218] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:11:28 2022] GET /compute/v2.1/servers/75f3574e-e02b-459a-88a6-6bb7f2b43be4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 18:11:29.706020 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-652243ae-0611-4657-9938-0404512194dc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:11:29.706531 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-652243ae-0611-4657-9938-0404512194dc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 845aadfa-e6fd-491a-86bb-0534aa1a45fd] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:11:29.713242 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-652243ae-0611-4657-9938-0404512194dc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:11:29.713700 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-652243ae-0611-4657-9938-0404512194dc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:11:29.714476 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-652243ae-0611-4657-9938-0404512194dc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:11:29.714921 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-652243ae-0611-4657-9938-0404512194dc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:11:29.728359 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.wsgi [None req-652243ae-0611-4657-9938-0404512194dc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] HTTP exception thrown: Instance 845aadfa-e6fd-491a-86bb-0534aa1a45fd could not be found. Jul 14 18:11:29.729935 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-652243ae-0611-4657-9938-0404512194dc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Request method failure captured: Jul 14 18:11:29.729935 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: request: DELETE /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd HTTP/1.1 Jul 14 18:11:29.729935 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept: application/json Jul 14 18:11:29.729935 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept-Encoding: identity Jul 14 18:11:29.729935 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Connection: close Jul 14 18:11:29.729935 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Length: 0 Jul 14 18:11:29.729935 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Type: application/json Jul 14 18:11:29.729935 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Host: 10.222.0.64 Jul 14 18:11:29.729935 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Openstack-System-Scope: None Jul 14 18:11:29.729935 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: User-Agent: python-urllib3/1.26.9 Jul 14 18:11:29.729935 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Auth-Token: gAAAAABi0FqQJwSdeIlyvTJTebGB2HswWMQXdEeVQ1nqnsr0mN7imW5yYBtB7v0AYBUvhZx3ERaakjDBC-y17nbWzPHdLShTJjvjoOWOEu2O2dHU4WvbtqYTFlYdN2M2cROj3RwdhDe-fwWgM_ya_OxtW44tU56VzqdTH9IrVrscBvrZes_8UeI Jul 14 18:11:29.729935 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Id: None Jul 14 18:11:29.729935 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Name: None Jul 14 18:11:29.729935 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Identity-Status: Confirmed Jul 14 18:11:29.729935 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Is-Admin-Project: True Jul 14 18:11:29.729935 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Id: default Jul 14 18:11:29.729935 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Name: Default Jul 14 18:11:29.729935 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Id: cd7b0d70fffe4d37a84bd4ee73d044ca Jul 14 18:11:29.729935 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Name: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:11:29.729935 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Role: reader,member Jul 14 18:11:29.729935 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Roles: reader,member Jul 14 18:11:29.731514 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cd7b0d70fffe4d37a84bd4ee73d044ca", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:11:29.731514 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:11:29.731514 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Id: cd7b0d70fffe4d37a84bd4ee73d044ca Jul 14 18:11:29.731514 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:11:29.731514 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User: tempest-AttachVolumeNegativeTest-775141180-project Jul 14 18:11:29.731514 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Id: default Jul 14 18:11:29.731514 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Name: Default Jul 14 18:11:29.731514 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Id: d1a7b2376e83489b87feb4b9fd449d55 Jul 14 18:11:29.731514 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Name: tempest-AttachVolumeNegativeTest-775141180-project Jul 14 18:11:29.731514 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: method: > Jul 14 18:11:29.731514 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: exception: Instance 845aadfa-e6fd-491a-86bb-0534aa1a45fd could not be found. Jul 14 18:11:29.731514 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: action_args: {'id': '845aadfa-e6fd-491a-86bb-0534aa1a45fd'} Jul 14 18:11:29.732532 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:11:29.732532 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:11:29.732532 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 18:11:29.732532 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 18:11:29.732532 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 18:11:29.732532 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 18:11:29.732532 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 18:11:29.732532 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 18:11:29.732532 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 18:11:29.732532 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 18:11:29.732532 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 845aadfa-e6fd-491a-86bb-0534aa1a45fd could not be found. Jul 14 18:11:29.732532 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:11:29.732532 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:11:29.732532 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:11:29.732532 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:11:29.732532 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:11:29.732532 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:11:29.732532 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:11:29.732532 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:11:29.732532 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:11:29.734128 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:11:29.734128 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 18:11:29.734128 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 18:11:29.734128 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 18:11:29.734128 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 18:11:29.734128 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 18:11:29.734128 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 18:11:29.734128 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 18:11:29.734128 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 18:11:29.734128 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 845aadfa-e6fd-491a-86bb-0534aa1a45fd could not be found. Jul 14 18:11:29.734128 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:11:29.734128 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:11:29.734128 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:11:29.734128 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:11:29.734128 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:11:29.734128 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:11:29.734128 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 18:11:29.734128 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 18:11:29.734128 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 845aadfa-e6fd-491a-86bb-0534aa1a45fd could not be found. Jul 14 18:11:29.734128 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:11:29.736274 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-652243ae-0611-4657-9938-0404512194dc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Returning 404 to user: Instance 845aadfa-e6fd-491a-86bb-0534aa1a45fd could not be found. {{(pid=129471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:11:29.736274 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-652243ae-0611-4657-9938-0404512194dc tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "DELETE /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd" status: 404 len: 111 microversion: 2.1 time: 0.029537 Jul 14 18:11:29.736274 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 631/1219] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Jul 14 18:11:29 2022] DELETE /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 18:11:29.741217 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-bd051d8e-eb76-435d-b322-f168b0fde0c5 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:11:29.741836 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-bd051d8e-eb76-435d-b322-f168b0fde0c5 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 845aadfa-e6fd-491a-86bb-0534aa1a45fd] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:11:29.748392 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-bd051d8e-eb76-435d-b322-f168b0fde0c5 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:11:29.748844 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-bd051d8e-eb76-435d-b322-f168b0fde0c5 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:11:29.749615 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-bd051d8e-eb76-435d-b322-f168b0fde0c5 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:11:29.750075 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-bd051d8e-eb76-435d-b322-f168b0fde0c5 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:11:29.764416 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.wsgi [None req-bd051d8e-eb76-435d-b322-f168b0fde0c5 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] HTTP exception thrown: Instance 845aadfa-e6fd-491a-86bb-0534aa1a45fd could not be found. Jul 14 18:11:29.766003 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-bd051d8e-eb76-435d-b322-f168b0fde0c5 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Request method failure captured: Jul 14 18:11:29.766003 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: request: GET /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd HTTP/1.1 Jul 14 18:11:29.766003 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept: application/json Jul 14 18:11:29.766003 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept-Encoding: identity Jul 14 18:11:29.766003 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Connection: close Jul 14 18:11:29.766003 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Length: 0 Jul 14 18:11:29.766003 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Type: application/json Jul 14 18:11:29.766003 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Host: 10.222.0.64 Jul 14 18:11:29.766003 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Openstack-System-Scope: None Jul 14 18:11:29.766003 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: User-Agent: python-urllib3/1.26.9 Jul 14 18:11:29.766003 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Auth-Token: gAAAAABi0FqQJwSdeIlyvTJTebGB2HswWMQXdEeVQ1nqnsr0mN7imW5yYBtB7v0AYBUvhZx3ERaakjDBC-y17nbWzPHdLShTJjvjoOWOEu2O2dHU4WvbtqYTFlYdN2M2cROj3RwdhDe-fwWgM_ya_OxtW44tU56VzqdTH9IrVrscBvrZes_8UeI Jul 14 18:11:29.766003 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Id: None Jul 14 18:11:29.766003 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Name: None Jul 14 18:11:29.766003 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Identity-Status: Confirmed Jul 14 18:11:29.766003 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Is-Admin-Project: True Jul 14 18:11:29.766003 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Id: default Jul 14 18:11:29.766003 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Name: Default Jul 14 18:11:29.766003 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Id: cd7b0d70fffe4d37a84bd4ee73d044ca Jul 14 18:11:29.766003 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Name: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:11:29.766003 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Role: reader,member Jul 14 18:11:29.766003 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Roles: reader,member Jul 14 18:11:29.767658 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cd7b0d70fffe4d37a84bd4ee73d044ca", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:11:29.767658 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:11:29.767658 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Id: cd7b0d70fffe4d37a84bd4ee73d044ca Jul 14 18:11:29.767658 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:11:29.767658 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User: tempest-AttachVolumeNegativeTest-775141180-project Jul 14 18:11:29.767658 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Id: default Jul 14 18:11:29.767658 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Name: Default Jul 14 18:11:29.767658 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Id: d1a7b2376e83489b87feb4b9fd449d55 Jul 14 18:11:29.767658 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Name: tempest-AttachVolumeNegativeTest-775141180-project Jul 14 18:11:29.767658 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: method: > Jul 14 18:11:29.767658 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: exception: Instance 845aadfa-e6fd-491a-86bb-0534aa1a45fd could not be found. Jul 14 18:11:29.767658 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: action_args: {'id': '845aadfa-e6fd-491a-86bb-0534aa1a45fd'} Jul 14 18:11:29.768682 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:11:29.768682 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:11:29.768682 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 18:11:29.768682 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 18:11:29.768682 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 18:11:29.768682 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 18:11:29.768682 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 18:11:29.768682 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 18:11:29.768682 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 18:11:29.768682 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 18:11:29.768682 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 845aadfa-e6fd-491a-86bb-0534aa1a45fd could not be found. Jul 14 18:11:29.768682 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:11:29.768682 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:11:29.768682 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:11:29.768682 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:11:29.768682 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:11:29.768682 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:11:29.768682 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:11:29.768682 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:11:29.768682 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:11:29.770227 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:11:29.770227 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 18:11:29.770227 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 18:11:29.770227 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 18:11:29.770227 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 18:11:29.770227 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 18:11:29.770227 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 18:11:29.770227 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 845aadfa-e6fd-491a-86bb-0534aa1a45fd could not be found. Jul 14 18:11:29.770227 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:11:29.770227 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:11:29.770227 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:11:29.770227 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:11:29.770227 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:11:29.770227 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:11:29.770227 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 18:11:29.770227 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 18:11:29.770227 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 845aadfa-e6fd-491a-86bb-0534aa1a45fd could not be found. Jul 14 18:11:29.770227 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:11:29.771639 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-bd051d8e-eb76-435d-b322-f168b0fde0c5 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Returning 404 to user: Instance 845aadfa-e6fd-491a-86bb-0534aa1a45fd could not be found. {{(pid=129470) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:11:29.771639 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-bd051d8e-eb76-435d-b322-f168b0fde0c5 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd" status: 404 len: 111 microversion: 2.1 time: 0.029985 Jul 14 18:11:29.771639 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 589/1220] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:11:29 2022] GET /compute/v2.1/servers/845aadfa-e6fd-491a-86bb-0534aa1a45fd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 18:11:29.775991 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-332cd17c-23e5-4742-8014-b470b5abf974 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:11:29.776498 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-332cd17c-23e5-4742-8014-b470b5abf974 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 9947ad7c-1b7a-4db5-8968-94691c54575a] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:11:29.783335 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-332cd17c-23e5-4742-8014-b470b5abf974 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:11:29.783789 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-332cd17c-23e5-4742-8014-b470b5abf974 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:11:29.784603 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-332cd17c-23e5-4742-8014-b470b5abf974 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:11:29.785047 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-332cd17c-23e5-4742-8014-b470b5abf974 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:11:29.798936 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.wsgi [None req-332cd17c-23e5-4742-8014-b470b5abf974 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] HTTP exception thrown: Instance 9947ad7c-1b7a-4db5-8968-94691c54575a could not be found. Jul 14 18:11:29.800547 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-332cd17c-23e5-4742-8014-b470b5abf974 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Request method failure captured: Jul 14 18:11:29.800547 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: request: DELETE /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a HTTP/1.1 Jul 14 18:11:29.800547 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept: application/json Jul 14 18:11:29.800547 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept-Encoding: identity Jul 14 18:11:29.800547 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Connection: close Jul 14 18:11:29.800547 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Length: 0 Jul 14 18:11:29.800547 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Type: application/json Jul 14 18:11:29.800547 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Host: 10.222.0.64 Jul 14 18:11:29.800547 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Openstack-System-Scope: None Jul 14 18:11:29.800547 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: User-Agent: python-urllib3/1.26.9 Jul 14 18:11:29.800547 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Auth-Token: gAAAAABi0FqQJwSdeIlyvTJTebGB2HswWMQXdEeVQ1nqnsr0mN7imW5yYBtB7v0AYBUvhZx3ERaakjDBC-y17nbWzPHdLShTJjvjoOWOEu2O2dHU4WvbtqYTFlYdN2M2cROj3RwdhDe-fwWgM_ya_OxtW44tU56VzqdTH9IrVrscBvrZes_8UeI Jul 14 18:11:29.800547 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Id: None Jul 14 18:11:29.800547 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Name: None Jul 14 18:11:29.800547 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Identity-Status: Confirmed Jul 14 18:11:29.800547 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Is-Admin-Project: True Jul 14 18:11:29.800547 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Id: default Jul 14 18:11:29.800547 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Name: Default Jul 14 18:11:29.800547 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Id: cd7b0d70fffe4d37a84bd4ee73d044ca Jul 14 18:11:29.800547 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Name: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:11:29.800547 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Role: reader,member Jul 14 18:11:29.800547 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Roles: reader,member Jul 14 18:11:29.802198 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cd7b0d70fffe4d37a84bd4ee73d044ca", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:11:29.802198 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:11:29.802198 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Id: cd7b0d70fffe4d37a84bd4ee73d044ca Jul 14 18:11:29.802198 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:11:29.802198 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User: tempest-AttachVolumeNegativeTest-775141180-project Jul 14 18:11:29.802198 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Id: default Jul 14 18:11:29.802198 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Name: Default Jul 14 18:11:29.802198 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Id: d1a7b2376e83489b87feb4b9fd449d55 Jul 14 18:11:29.802198 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Name: tempest-AttachVolumeNegativeTest-775141180-project Jul 14 18:11:29.802198 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: method: > Jul 14 18:11:29.802198 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: exception: Instance 9947ad7c-1b7a-4db5-8968-94691c54575a could not be found. Jul 14 18:11:29.802198 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: action_args: {'id': '9947ad7c-1b7a-4db5-8968-94691c54575a'} Jul 14 18:11:29.803050 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:11:29.803050 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:11:29.803050 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 18:11:29.803050 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 18:11:29.803050 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 18:11:29.803050 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 18:11:29.803050 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 18:11:29.803050 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 18:11:29.803050 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 18:11:29.803050 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 18:11:29.803050 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9947ad7c-1b7a-4db5-8968-94691c54575a could not be found. Jul 14 18:11:29.803050 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:11:29.803050 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:11:29.803050 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:11:29.803050 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:11:29.803050 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:11:29.803050 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:11:29.803050 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:11:29.803050 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:11:29.803050 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:11:29.804373 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:11:29.804373 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 18:11:29.804373 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 18:11:29.804373 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 18:11:29.804373 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 18:11:29.804373 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 18:11:29.804373 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 18:11:29.804373 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 18:11:29.804373 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 18:11:29.804373 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9947ad7c-1b7a-4db5-8968-94691c54575a could not be found. Jul 14 18:11:29.804373 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:11:29.804373 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:11:29.804373 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:11:29.804373 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:11:29.804373 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:11:29.804373 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:11:29.804373 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 18:11:29.804373 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 18:11:29.804373 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9947ad7c-1b7a-4db5-8968-94691c54575a could not be found. Jul 14 18:11:29.804373 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:11:29.808342 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-332cd17c-23e5-4742-8014-b470b5abf974 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Returning 404 to user: Instance 9947ad7c-1b7a-4db5-8968-94691c54575a could not be found. {{(pid=129471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:11:29.808342 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-332cd17c-23e5-4742-8014-b470b5abf974 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "DELETE /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a" status: 404 len: 111 microversion: 2.1 time: 0.029817 Jul 14 18:11:29.808342 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 632/1221] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Jul 14 18:11:29 2022] DELETE /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 18:11:29.810338 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-6b5cdf52-f12c-4213-9d0a-a88c5785fcae tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:11:29.810954 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-6b5cdf52-f12c-4213-9d0a-a88c5785fcae tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 9947ad7c-1b7a-4db5-8968-94691c54575a] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:11:29.817674 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6b5cdf52-f12c-4213-9d0a-a88c5785fcae tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:11:29.818130 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6b5cdf52-f12c-4213-9d0a-a88c5785fcae tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:11:29.818918 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6b5cdf52-f12c-4213-9d0a-a88c5785fcae tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:11:29.819347 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6b5cdf52-f12c-4213-9d0a-a88c5785fcae tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:11:29.832649 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.wsgi [None req-6b5cdf52-f12c-4213-9d0a-a88c5785fcae tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] HTTP exception thrown: Instance 9947ad7c-1b7a-4db5-8968-94691c54575a could not be found. Jul 14 18:11:29.834146 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-6b5cdf52-f12c-4213-9d0a-a88c5785fcae tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Request method failure captured: Jul 14 18:11:29.834146 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: request: GET /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a HTTP/1.1 Jul 14 18:11:29.834146 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept: application/json Jul 14 18:11:29.834146 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept-Encoding: identity Jul 14 18:11:29.834146 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Connection: close Jul 14 18:11:29.834146 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Length: 0 Jul 14 18:11:29.834146 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Type: application/json Jul 14 18:11:29.834146 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Host: 10.222.0.64 Jul 14 18:11:29.834146 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Openstack-System-Scope: None Jul 14 18:11:29.834146 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: User-Agent: python-urllib3/1.26.9 Jul 14 18:11:29.834146 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Auth-Token: gAAAAABi0FqQJwSdeIlyvTJTebGB2HswWMQXdEeVQ1nqnsr0mN7imW5yYBtB7v0AYBUvhZx3ERaakjDBC-y17nbWzPHdLShTJjvjoOWOEu2O2dHU4WvbtqYTFlYdN2M2cROj3RwdhDe-fwWgM_ya_OxtW44tU56VzqdTH9IrVrscBvrZes_8UeI Jul 14 18:11:29.834146 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Id: None Jul 14 18:11:29.834146 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Name: None Jul 14 18:11:29.834146 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Identity-Status: Confirmed Jul 14 18:11:29.834146 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Is-Admin-Project: True Jul 14 18:11:29.834146 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Id: default Jul 14 18:11:29.834146 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Name: Default Jul 14 18:11:29.834146 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Id: cd7b0d70fffe4d37a84bd4ee73d044ca Jul 14 18:11:29.834146 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Name: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:11:29.834146 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Role: reader,member Jul 14 18:11:29.834146 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Roles: reader,member Jul 14 18:11:29.835813 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cd7b0d70fffe4d37a84bd4ee73d044ca", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:11:29.835813 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:11:29.835813 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Id: cd7b0d70fffe4d37a84bd4ee73d044ca Jul 14 18:11:29.835813 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:11:29.835813 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User: tempest-AttachVolumeNegativeTest-775141180-project Jul 14 18:11:29.835813 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Id: default Jul 14 18:11:29.835813 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Name: Default Jul 14 18:11:29.835813 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Id: d1a7b2376e83489b87feb4b9fd449d55 Jul 14 18:11:29.835813 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Name: tempest-AttachVolumeNegativeTest-775141180-project Jul 14 18:11:29.835813 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: method: > Jul 14 18:11:29.835813 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: exception: Instance 9947ad7c-1b7a-4db5-8968-94691c54575a could not be found. Jul 14 18:11:29.835813 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: action_args: {'id': '9947ad7c-1b7a-4db5-8968-94691c54575a'} Jul 14 18:11:29.836738 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:11:29.836738 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:11:29.836738 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 18:11:29.836738 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 18:11:29.836738 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 18:11:29.836738 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 18:11:29.836738 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 18:11:29.836738 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 18:11:29.836738 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 18:11:29.836738 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 18:11:29.836738 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9947ad7c-1b7a-4db5-8968-94691c54575a could not be found. Jul 14 18:11:29.836738 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:11:29.836738 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:11:29.836738 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:11:29.836738 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:11:29.836738 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:11:29.836738 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:11:29.836738 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:11:29.836738 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:11:29.836738 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:11:29.838284 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:11:29.838284 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 18:11:29.838284 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 18:11:29.838284 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 18:11:29.838284 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 18:11:29.838284 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 18:11:29.838284 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 18:11:29.838284 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9947ad7c-1b7a-4db5-8968-94691c54575a could not be found. Jul 14 18:11:29.838284 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:11:29.838284 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:11:29.838284 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:11:29.838284 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:11:29.838284 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:11:29.838284 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:11:29.838284 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 18:11:29.838284 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 18:11:29.838284 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9947ad7c-1b7a-4db5-8968-94691c54575a could not be found. Jul 14 18:11:29.838284 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:11:29.839662 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-6b5cdf52-f12c-4213-9d0a-a88c5785fcae tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Returning 404 to user: Instance 9947ad7c-1b7a-4db5-8968-94691c54575a could not be found. {{(pid=129470) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:11:29.839662 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-6b5cdf52-f12c-4213-9d0a-a88c5785fcae tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a" status: 404 len: 111 microversion: 2.1 time: 0.029006 Jul 14 18:11:29.839662 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 590/1222] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:11:29 2022] GET /compute/v2.1/servers/9947ad7c-1b7a-4db5-8968-94691c54575a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 18:11:30.981137 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-91b00489-1354-4f58-b112-e91318a4ae26 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:11:30.981641 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-91b00489-1354-4f58-b112-e91318a4ae26 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 939413a2-1f95-42f5-ad28-5fd1470b709f] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:11:30.988156 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-91b00489-1354-4f58-b112-e91318a4ae26 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:11:30.988608 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-91b00489-1354-4f58-b112-e91318a4ae26 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:11:30.989372 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-91b00489-1354-4f58-b112-e91318a4ae26 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:11:30.989810 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-91b00489-1354-4f58-b112-e91318a4ae26 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:11:31.005025 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.wsgi [None req-91b00489-1354-4f58-b112-e91318a4ae26 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] HTTP exception thrown: Instance 939413a2-1f95-42f5-ad28-5fd1470b709f could not be found. Jul 14 18:11:31.006564 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-91b00489-1354-4f58-b112-e91318a4ae26 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Request method failure captured: Jul 14 18:11:31.006564 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: request: DELETE /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f HTTP/1.1 Jul 14 18:11:31.006564 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept: application/json Jul 14 18:11:31.006564 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept-Encoding: identity Jul 14 18:11:31.006564 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Connection: close Jul 14 18:11:31.006564 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Length: 0 Jul 14 18:11:31.006564 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Type: application/json Jul 14 18:11:31.006564 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Host: 10.222.0.64 Jul 14 18:11:31.006564 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Openstack-System-Scope: None Jul 14 18:11:31.006564 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: User-Agent: python-urllib3/1.26.9 Jul 14 18:11:31.006564 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Auth-Token: gAAAAABi0FqQJwSdeIlyvTJTebGB2HswWMQXdEeVQ1nqnsr0mN7imW5yYBtB7v0AYBUvhZx3ERaakjDBC-y17nbWzPHdLShTJjvjoOWOEu2O2dHU4WvbtqYTFlYdN2M2cROj3RwdhDe-fwWgM_ya_OxtW44tU56VzqdTH9IrVrscBvrZes_8UeI Jul 14 18:11:31.006564 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Id: None Jul 14 18:11:31.006564 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Name: None Jul 14 18:11:31.006564 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Identity-Status: Confirmed Jul 14 18:11:31.006564 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Is-Admin-Project: True Jul 14 18:11:31.006564 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Id: default Jul 14 18:11:31.006564 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Name: Default Jul 14 18:11:31.006564 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Id: cd7b0d70fffe4d37a84bd4ee73d044ca Jul 14 18:11:31.006564 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Name: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:11:31.006564 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Role: reader,member Jul 14 18:11:31.006564 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Roles: reader,member Jul 14 18:11:31.008331 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cd7b0d70fffe4d37a84bd4ee73d044ca", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:11:31.008331 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:11:31.008331 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Id: cd7b0d70fffe4d37a84bd4ee73d044ca Jul 14 18:11:31.008331 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:11:31.008331 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User: tempest-AttachVolumeNegativeTest-775141180-project Jul 14 18:11:31.008331 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Id: default Jul 14 18:11:31.008331 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Name: Default Jul 14 18:11:31.008331 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Id: d1a7b2376e83489b87feb4b9fd449d55 Jul 14 18:11:31.008331 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Name: tempest-AttachVolumeNegativeTest-775141180-project Jul 14 18:11:31.008331 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: method: > Jul 14 18:11:31.008331 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: exception: Instance 939413a2-1f95-42f5-ad28-5fd1470b709f could not be found. Jul 14 18:11:31.008331 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: action_args: {'id': '939413a2-1f95-42f5-ad28-5fd1470b709f'} Jul 14 18:11:31.009304 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:11:31.009304 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:11:31.009304 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 18:11:31.009304 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 18:11:31.009304 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 18:11:31.009304 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 18:11:31.009304 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 18:11:31.009304 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 18:11:31.009304 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 18:11:31.009304 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 18:11:31.009304 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 939413a2-1f95-42f5-ad28-5fd1470b709f could not be found. Jul 14 18:11:31.009304 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:11:31.009304 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:11:31.009304 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:11:31.009304 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:11:31.009304 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:11:31.009304 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:11:31.009304 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:11:31.009304 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:11:31.009304 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:11:31.010860 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:11:31.010860 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 18:11:31.010860 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 18:11:31.010860 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 18:11:31.010860 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 18:11:31.010860 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 18:11:31.010860 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 18:11:31.010860 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 18:11:31.010860 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 18:11:31.010860 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 939413a2-1f95-42f5-ad28-5fd1470b709f could not be found. Jul 14 18:11:31.010860 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:11:31.010860 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:11:31.010860 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:11:31.010860 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:11:31.010860 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:11:31.010860 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:11:31.010860 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 18:11:31.010860 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 18:11:31.010860 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 939413a2-1f95-42f5-ad28-5fd1470b709f could not be found. Jul 14 18:11:31.010860 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:11:31.012683 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-91b00489-1354-4f58-b112-e91318a4ae26 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Returning 404 to user: Instance 939413a2-1f95-42f5-ad28-5fd1470b709f could not be found. {{(pid=129471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:11:31.012683 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-91b00489-1354-4f58-b112-e91318a4ae26 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "DELETE /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f" status: 404 len: 111 microversion: 2.1 time: 0.030748 Jul 14 18:11:31.012683 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 633/1223] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Jul 14 18:11:30 2022] DELETE /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 18:11:31.016514 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-bab9f79a-bf11-4763-ba83-68ff5fdcea90 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:11:31.017818 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-bab9f79a-bf11-4763-ba83-68ff5fdcea90 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] [instance: 939413a2-1f95-42f5-ad28-5fd1470b709f] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:11:31.024444 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-bab9f79a-bf11-4763-ba83-68ff5fdcea90 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:11:31.024894 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-bab9f79a-bf11-4763-ba83-68ff5fdcea90 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:11:31.025668 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-bab9f79a-bf11-4763-ba83-68ff5fdcea90 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:11:31.026138 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-bab9f79a-bf11-4763-ba83-68ff5fdcea90 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:11:31.039593 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.wsgi [None req-bab9f79a-bf11-4763-ba83-68ff5fdcea90 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] HTTP exception thrown: Instance 939413a2-1f95-42f5-ad28-5fd1470b709f could not be found. Jul 14 18:11:31.041151 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-bab9f79a-bf11-4763-ba83-68ff5fdcea90 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Request method failure captured: Jul 14 18:11:31.041151 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: request: GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f HTTP/1.1 Jul 14 18:11:31.041151 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept: application/json Jul 14 18:11:31.041151 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept-Encoding: identity Jul 14 18:11:31.041151 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Connection: close Jul 14 18:11:31.041151 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Length: 0 Jul 14 18:11:31.041151 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Type: application/json Jul 14 18:11:31.041151 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Host: 10.222.0.64 Jul 14 18:11:31.041151 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Openstack-System-Scope: None Jul 14 18:11:31.041151 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: User-Agent: python-urllib3/1.26.9 Jul 14 18:11:31.041151 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Auth-Token: gAAAAABi0FqQJwSdeIlyvTJTebGB2HswWMQXdEeVQ1nqnsr0mN7imW5yYBtB7v0AYBUvhZx3ERaakjDBC-y17nbWzPHdLShTJjvjoOWOEu2O2dHU4WvbtqYTFlYdN2M2cROj3RwdhDe-fwWgM_ya_OxtW44tU56VzqdTH9IrVrscBvrZes_8UeI Jul 14 18:11:31.041151 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Id: None Jul 14 18:11:31.041151 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Name: None Jul 14 18:11:31.041151 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Identity-Status: Confirmed Jul 14 18:11:31.041151 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Is-Admin-Project: True Jul 14 18:11:31.041151 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Id: default Jul 14 18:11:31.041151 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Name: Default Jul 14 18:11:31.041151 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Id: cd7b0d70fffe4d37a84bd4ee73d044ca Jul 14 18:11:31.041151 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Name: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:11:31.041151 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Role: reader,member Jul 14 18:11:31.041151 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Roles: reader,member Jul 14 18:11:31.042813 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cd7b0d70fffe4d37a84bd4ee73d044ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cd7b0d70fffe4d37a84bd4ee73d044ca", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:11:31.042813 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:11:31.042813 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Id: cd7b0d70fffe4d37a84bd4ee73d044ca Jul 14 18:11:31.042813 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-775141180 Jul 14 18:11:31.042813 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User: tempest-AttachVolumeNegativeTest-775141180-project Jul 14 18:11:31.042813 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Id: default Jul 14 18:11:31.042813 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Name: Default Jul 14 18:11:31.042813 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Id: d1a7b2376e83489b87feb4b9fd449d55 Jul 14 18:11:31.042813 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Name: tempest-AttachVolumeNegativeTest-775141180-project Jul 14 18:11:31.042813 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: method: > Jul 14 18:11:31.042813 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: exception: Instance 939413a2-1f95-42f5-ad28-5fd1470b709f could not be found. Jul 14 18:11:31.042813 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: action_args: {'id': '939413a2-1f95-42f5-ad28-5fd1470b709f'} Jul 14 18:11:31.043769 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:11:31.043769 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:11:31.043769 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 18:11:31.043769 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 18:11:31.043769 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 18:11:31.043769 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 18:11:31.043769 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 18:11:31.043769 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 18:11:31.043769 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 18:11:31.043769 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 18:11:31.043769 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 939413a2-1f95-42f5-ad28-5fd1470b709f could not be found. Jul 14 18:11:31.043769 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:11:31.043769 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:11:31.043769 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:11:31.043769 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:11:31.043769 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:11:31.043769 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:11:31.043769 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:11:31.043769 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:11:31.043769 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:11:31.045427 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:11:31.045427 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 18:11:31.045427 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 18:11:31.045427 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 18:11:31.045427 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 18:11:31.045427 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 18:11:31.045427 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 18:11:31.045427 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 939413a2-1f95-42f5-ad28-5fd1470b709f could not be found. Jul 14 18:11:31.045427 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:11:31.045427 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:11:31.045427 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:11:31.045427 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:11:31.045427 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:11:31.045427 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:11:31.045427 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 18:11:31.045427 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 18:11:31.045427 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 939413a2-1f95-42f5-ad28-5fd1470b709f could not be found. Jul 14 18:11:31.045427 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:11:31.046829 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-bab9f79a-bf11-4763-ba83-68ff5fdcea90 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] Returning 404 to user: Instance 939413a2-1f95-42f5-ad28-5fd1470b709f could not be found. {{(pid=129470) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:11:31.046829 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-bab9f79a-bf11-4763-ba83-68ff5fdcea90 tempest-AttachVolumeNegativeTest-775141180 tempest-AttachVolumeNegativeTest-775141180-project] 10.222.0.64 "GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f" status: 404 len: 111 microversion: 2.1 time: 0.029845 Jul 14 18:11:31.046829 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 591/1224] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:11:31 2022] GET /compute/v2.1/servers/939413a2-1f95-42f5-ad28-5fd1470b709f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 18:12:03.666116 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 18:12:03.666660 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Thu Jul 14 18:12:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 18:12:06.677512 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 18:12:06.678185 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Thu Jul 14 18:12:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 18:12:50.982166 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_api:SELECT=20 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:12:50.982926 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:12:51.188241 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-da58adc0-7a97-484a-95a5-3aedef02b7b7 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Action: 'create', calling method: .version_select at 0x7f137b58af70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1877107686", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfj0u+ZwcM8xbTizLNZYUMhXXVnW9/W/XEbHcqzyKMqg7pYFvNNkndgjvX6a/PmKSqfJVEnYA/vbnGzLnMiQHTPwOdN53pfuj12BwQlK8z+6q1tQeNJ1t5sF/hzE5FlgA=="}} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:12:51.203686 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.quota [None req-da58adc0-7a97-484a-95a5-3aedef02b7b7 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Getting quotas for project 3a189153b8f44520a5bac2c4bcedc013. Resources: {'key_pairs'} {{(pid=129471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 18:12:51.207852 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.quota [None req-da58adc0-7a97-484a-95a5-3aedef02b7b7 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Getting quotas for user 15d9d47d160b4595a16bf23eaa509a08 and project 3a189153b8f44520a5bac2c4bcedc013. Resources: {'key_pairs'} {{(pid=129471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 18:12:51.235232 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-da58adc0-7a97-484a-95a5-3aedef02b7b7 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.254737 Jul 14 18:12:51.236058 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 634/1225] 10.222.0.64 () {60 vars in 1158 bytes} [Thu Jul 14 18:12:50 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:13:15.026264 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:13:15.027013 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:13:15.032123 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-1a6cbe51-9369-423e-a16f-05fb2faff94a tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-885855874", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1877107686", "security_groups": [{"name": "tempest-secgroup-smoke-355181516"}], "block_device_mapping_v2": [{"uuid": "d02e69b7-2f14-419e-848e-39c7437fed02", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0f1b18ec-16ad-4386-b70c-cceb4fb57ee1"}]}} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:13:15.412613 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.network.neutron [None req-1a6cbe51-9369-423e-a16f-05fb2faff94a tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] validate_networks() for [('0f1b18ec-16ad-4386-b70c-cceb4fb57ee1', None, None, None, None, None)] {{(pid=129470) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 18:13:15.864881 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-1a6cbe51-9369-423e-a16f-05fb2faff94a tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Flavor limits 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 18:13:15.865344 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-1a6cbe51-9369-423e-a16f-05fb2faff94a tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Image limits 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 18:13:15.865834 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-1a6cbe51-9369-423e-a16f-05fb2faff94a tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Flavor pref 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 18:13:15.866256 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-1a6cbe51-9369-423e-a16f-05fb2faff94a tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Image pref 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 18:13:15.866682 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-1a6cbe51-9369-423e-a16f-05fb2faff94a tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 18:13:15.876217 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1a6cbe51-9369-423e-a16f-05fb2faff94a tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:13:15.876679 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1a6cbe51-9369-423e-a16f-05fb2faff94a tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:13:15.877489 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1a6cbe51-9369-423e-a16f-05fb2faff94a tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:13:15.877933 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-1a6cbe51-9369-423e-a16f-05fb2faff94a tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:13:15.894341 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.quota [None req-1a6cbe51-9369-423e-a16f-05fb2faff94a tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Getting quotas for project 3a189153b8f44520a5bac2c4bcedc013. Resources: {'ram', 'cores', 'instances'} {{(pid=129470) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 18:13:15.898321 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.quota [None req-1a6cbe51-9369-423e-a16f-05fb2faff94a tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Getting quotas for user 15d9d47d160b4595a16bf23eaa509a08 and project 3a189153b8f44520a5bac2c4bcedc013. Resources: {'ram', 'cores', 'instances'} {{(pid=129470) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 18:13:15.954850 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-1a6cbe51-9369-423e-a16f-05fb2faff94a tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Going to run 1 instances... {{(pid=129470) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 18:13:15.956995 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-1a6cbe51-9369-423e-a16f-05fb2faff94a tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d02e69b7-2f14-419e-848e-39c7437fed02',volume_size=None,volume_type=None)] {{(pid=129470) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 18:13:16.087992 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-1a6cbe51-9369-423e-a16f-05fb2faff94a tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.063797 Jul 14 18:13:16.088953 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 592/1226] 10.222.0.64 () {60 vars in 1146 bytes} [Thu Jul 14 18:13:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 1065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 18:13:16.099158 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-0cca0342-da45-46ef-94cb-e347966ab801 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:13:16.099787 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-0cca0342-da45-46ef-94cb-e347966ab801 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:13:16.102942 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell0:SELECT=4 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:13:16.104775 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:13:16.216210 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-0cca0342-da45-46ef-94cb-e347966ab801 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:13:16.223028 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-0cca0342-da45-46ef-94cb-e347966ab801 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3" status: 200 len: 1094 microversion: 2.1 time: 0.128103 Jul 14 18:13:16.223601 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 635/1227] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:13:16 2022] GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 => generated 1094 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:13:17.241214 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-4d773e27-ee8e-44cb-8dcf-6e0856010641 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:13:17.241981 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-4d773e27-ee8e-44cb-8dcf-6e0856010641 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:13:17.249014 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4d773e27-ee8e-44cb-8dcf-6e0856010641 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:13:17.249639 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4d773e27-ee8e-44cb-8dcf-6e0856010641 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:13:17.251178 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4d773e27-ee8e-44cb-8dcf-6e0856010641 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:13:17.251638 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-4d773e27-ee8e-44cb-8dcf-6e0856010641 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:13:17.315894 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-4d773e27-ee8e-44cb-8dcf-6e0856010641 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:13:17.323323 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-4d773e27-ee8e-44cb-8dcf-6e0856010641 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3" status: 200 len: 1210 microversion: 2.1 time: 0.086847 Jul 14 18:13:17.323893 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 593/1228] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:13:17 2022] GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:13:18.340501 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-7d615495-0c06-4305-92cb-d296ea4f11d4 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:13:18.341479 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-7d615495-0c06-4305-92cb-d296ea4f11d4 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:13:18.350453 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7d615495-0c06-4305-92cb-d296ea4f11d4 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:13:18.350628 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7d615495-0c06-4305-92cb-d296ea4f11d4 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:13:18.351442 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7d615495-0c06-4305-92cb-d296ea4f11d4 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:13:18.352001 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-7d615495-0c06-4305-92cb-d296ea4f11d4 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:13:18.486105 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-30b084fd-bd8e-414d-a0de-36b628156ef1 req-ed671fa3-7fb5-4531-bedf-a49cb8bc6425 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3", "tag": "aeb130e2-30d4-4356-a15c-d00104f9102e"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:13:18.502174 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-7d615495-0c06-4305-92cb-d296ea4f11d4 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:13:18.504887 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-30b084fd-bd8e-414d-a0de-36b628156ef1 req-ed671fa3-7fb5-4531-bedf-a49cb8bc6425 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:13:18.505337 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-30b084fd-bd8e-414d-a0de-36b628156ef1 req-ed671fa3-7fb5-4531-bedf-a49cb8bc6425 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:13:18.517515 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-30b084fd-bd8e-414d-a0de-36b628156ef1 req-ed671fa3-7fb5-4531-bedf-a49cb8bc6425 service nova] Creating event network-changed:aeb130e2-30d4-4356-a15c-d00104f9102e for instance 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 on hv-cinder-84989 Jul 14 18:13:18.517727 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-7d615495-0c06-4305-92cb-d296ea4f11d4 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3" status: 200 len: 1265 microversion: 2.1 time: 0.180179 Jul 14 18:13:18.518508 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 636/1229] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:13:18 2022] GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:13:18.529889 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-30b084fd-bd8e-414d-a0de-36b628156ef1 req-ed671fa3-7fb5-4531-bedf-a49cb8bc6425 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048319 Jul 14 18:13:18.530529 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 594/1230] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:13:19.535529 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-2d8fca5a-34da-4b89-90e6-a031b0523ca8 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:13:19.536173 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-2d8fca5a-34da-4b89-90e6-a031b0523ca8 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:13:19.542765 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2d8fca5a-34da-4b89-90e6-a031b0523ca8 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:13:19.543216 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2d8fca5a-34da-4b89-90e6-a031b0523ca8 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:13:19.544012 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2d8fca5a-34da-4b89-90e6-a031b0523ca8 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:13:19.544454 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-2d8fca5a-34da-4b89-90e6-a031b0523ca8 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:13:19.674026 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-2d8fca5a-34da-4b89-90e6-a031b0523ca8 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:13:19.681685 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-2d8fca5a-34da-4b89-90e6-a031b0523ca8 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3" status: 200 len: 1265 microversion: 2.1 time: 0.150604 Jul 14 18:13:19.682255 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 637/1231] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:13:19 2022] GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:13:20.699530 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-7d9b338c-4f54-4791-b021-ac3abdc55e2e tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:13:20.700273 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-7d9b338c-4f54-4791-b021-ac3abdc55e2e tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:13:20.706560 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7d9b338c-4f54-4791-b021-ac3abdc55e2e tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:13:20.707016 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7d9b338c-4f54-4791-b021-ac3abdc55e2e tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:13:20.707806 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7d9b338c-4f54-4791-b021-ac3abdc55e2e tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:13:20.708275 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7d9b338c-4f54-4791-b021-ac3abdc55e2e tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:13:20.842361 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-7d9b338c-4f54-4791-b021-ac3abdc55e2e tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:13:20.850273 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-7d9b338c-4f54-4791-b021-ac3abdc55e2e tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3" status: 200 len: 1265 microversion: 2.1 time: 0.155395 Jul 14 18:13:20.850932 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 595/1232] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:13:20 2022] GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:13:21.867270 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-3369f20d-f2d8-40e5-bef9-ef0c4d5e9bbe tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:13:21.867945 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-3369f20d-f2d8-40e5-bef9-ef0c4d5e9bbe tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:13:21.874398 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3369f20d-f2d8-40e5-bef9-ef0c4d5e9bbe tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:13:21.874854 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3369f20d-f2d8-40e5-bef9-ef0c4d5e9bbe tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:13:21.875631 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3369f20d-f2d8-40e5-bef9-ef0c4d5e9bbe tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:13:21.876849 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-3369f20d-f2d8-40e5-bef9-ef0c4d5e9bbe tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:13:22.007069 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-3369f20d-f2d8-40e5-bef9-ef0c4d5e9bbe tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:13:22.014493 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-3369f20d-f2d8-40e5-bef9-ef0c4d5e9bbe tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3" status: 200 len: 1265 microversion: 2.1 time: 0.151213 Jul 14 18:13:22.015054 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 638/1233] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:13:21 2022] GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:13:23.031801 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-43dd7a3b-6a5f-4a2b-a6c6-0322d7a4b1b3 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:13:23.033295 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-43dd7a3b-6a5f-4a2b-a6c6-0322d7a4b1b3 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:13:23.044793 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-43dd7a3b-6a5f-4a2b-a6c6-0322d7a4b1b3 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:13:23.045246 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-43dd7a3b-6a5f-4a2b-a6c6-0322d7a4b1b3 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:13:23.046027 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-43dd7a3b-6a5f-4a2b-a6c6-0322d7a4b1b3 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:13:23.046464 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-43dd7a3b-6a5f-4a2b-a6c6-0322d7a4b1b3 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:13:23.177256 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-43dd7a3b-6a5f-4a2b-a6c6-0322d7a4b1b3 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:13:23.184818 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-43dd7a3b-6a5f-4a2b-a6c6-0322d7a4b1b3 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3" status: 200 len: 1265 microversion: 2.1 time: 0.156944 Jul 14 18:13:23.185387 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 596/1234] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:13:23 2022] GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:13:24.201651 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-467bff0b-1750-4832-8da2-b77d7cd6445b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:13:24.202270 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-467bff0b-1750-4832-8da2-b77d7cd6445b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:13:24.208804 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-467bff0b-1750-4832-8da2-b77d7cd6445b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:13:24.209262 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-467bff0b-1750-4832-8da2-b77d7cd6445b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:13:24.210034 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-467bff0b-1750-4832-8da2-b77d7cd6445b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:13:24.210477 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-467bff0b-1750-4832-8da2-b77d7cd6445b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:13:24.338407 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-467bff0b-1750-4832-8da2-b77d7cd6445b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:13:24.346620 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-467bff0b-1750-4832-8da2-b77d7cd6445b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3" status: 200 len: 1265 microversion: 2.1 time: 0.148818 Jul 14 18:13:24.347189 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 639/1235] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:13:24 2022] GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:13:25.363182 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-348f9ce7-c328-42aa-bd4b-c9f87e633b37 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:13:25.363730 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-348f9ce7-c328-42aa-bd4b-c9f87e633b37 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:13:25.370393 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-348f9ce7-c328-42aa-bd4b-c9f87e633b37 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:13:25.370845 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-348f9ce7-c328-42aa-bd4b-c9f87e633b37 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:13:25.371617 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-348f9ce7-c328-42aa-bd4b-c9f87e633b37 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:13:25.372085 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-348f9ce7-c328-42aa-bd4b-c9f87e633b37 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:13:25.503389 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-348f9ce7-c328-42aa-bd4b-c9f87e633b37 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:13:25.520330 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-348f9ce7-c328-42aa-bd4b-c9f87e633b37 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3" status: 200 len: 1265 microversion: 2.1 time: 0.161484 Jul 14 18:13:25.520981 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 597/1236] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:13:25 2022] GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:13:26.537993 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-33d21fb7-cf87-4e4a-b6c9-7b3291824517 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:13:26.538604 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-33d21fb7-cf87-4e4a-b6c9-7b3291824517 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:13:26.540947 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell0:SELECT=2 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:13:26.546461 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-33d21fb7-cf87-4e4a-b6c9-7b3291824517 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:13:26.546909 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-33d21fb7-cf87-4e4a-b6c9-7b3291824517 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:13:26.548247 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-33d21fb7-cf87-4e4a-b6c9-7b3291824517 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:13:26.548680 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-33d21fb7-cf87-4e4a-b6c9-7b3291824517 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:13:26.680276 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-33d21fb7-cf87-4e4a-b6c9-7b3291824517 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:13:26.687850 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-33d21fb7-cf87-4e4a-b6c9-7b3291824517 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3" status: 200 len: 1265 microversion: 2.1 time: 0.153715 Jul 14 18:13:26.688462 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 640/1237] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:13:26 2022] GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:13:27.705078 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-34b869cb-3213-49d8-9fb6-659666ced922 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:13:27.705688 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-34b869cb-3213-49d8-9fb6-659666ced922 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:13:27.707630 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell0:SELECT=2 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:13:27.708395 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell0:SELECT=6 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:13:27.714792 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-34b869cb-3213-49d8-9fb6-659666ced922 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:13:27.715249 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-34b869cb-3213-49d8-9fb6-659666ced922 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:13:27.716075 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-34b869cb-3213-49d8-9fb6-659666ced922 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:13:27.716521 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-34b869cb-3213-49d8-9fb6-659666ced922 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:13:27.851456 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-34b869cb-3213-49d8-9fb6-659666ced922 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:13:27.861726 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-34b869cb-3213-49d8-9fb6-659666ced922 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3" status: 200 len: 1265 microversion: 2.1 time: 0.160922 Jul 14 18:13:27.862316 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 598/1238] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:13:27 2022] GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:13:28.879009 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-544b99d6-2ea9-40f3-b7db-7f204487d63d tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:13:28.879610 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-544b99d6-2ea9-40f3-b7db-7f204487d63d tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:13:28.886103 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-544b99d6-2ea9-40f3-b7db-7f204487d63d tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:13:28.886555 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-544b99d6-2ea9-40f3-b7db-7f204487d63d tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:13:28.887327 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-544b99d6-2ea9-40f3-b7db-7f204487d63d tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:13:28.887761 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-544b99d6-2ea9-40f3-b7db-7f204487d63d tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:13:29.022828 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-544b99d6-2ea9-40f3-b7db-7f204487d63d tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:13:29.030609 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-544b99d6-2ea9-40f3-b7db-7f204487d63d tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3" status: 200 len: 1265 microversion: 2.1 time: 0.156041 Jul 14 18:13:29.031180 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 641/1239] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:13:28 2022] GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:13:29.223948 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-3e8d29ad-e1c8-45e6-b58d-3917f4d0b2ca req-f0fdda7e-8b8e-492a-a3bd-f57004ac3579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3", "name": "network-vif-plugged", "status": "completed", "tag": "aeb130e2-30d4-4356-a15c-d00104f9102e"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:13:29.232694 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-3e8d29ad-e1c8-45e6-b58d-3917f4d0b2ca req-f0fdda7e-8b8e-492a-a3bd-f57004ac3579 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:13:29.233199 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-3e8d29ad-e1c8-45e6-b58d-3917f4d0b2ca req-f0fdda7e-8b8e-492a-a3bd-f57004ac3579 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:13:29.244296 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-3e8d29ad-e1c8-45e6-b58d-3917f4d0b2ca req-f0fdda7e-8b8e-492a-a3bd-f57004ac3579 service nova] Creating event network-vif-plugged:aeb130e2-30d4-4356-a15c-d00104f9102e for instance 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 on hv-cinder-84989 Jul 14 18:13:29.249186 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-3e8d29ad-e1c8-45e6-b58d-3917f4d0b2ca req-f0fdda7e-8b8e-492a-a3bd-f57004ac3579 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028956 Jul 14 18:13:29.249769 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 599/1240] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:13:30.046591 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-d378f40a-a24c-44d6-bd59-97f958084162 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:13:30.047695 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-d378f40a-a24c-44d6-bd59-97f958084162 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:13:30.054310 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d378f40a-a24c-44d6-bd59-97f958084162 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:13:30.054761 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d378f40a-a24c-44d6-bd59-97f958084162 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:13:30.055526 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d378f40a-a24c-44d6-bd59-97f958084162 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:13:30.055993 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d378f40a-a24c-44d6-bd59-97f958084162 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:13:30.184540 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-d378f40a-a24c-44d6-bd59-97f958084162 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:13:30.192498 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-d378f40a-a24c-44d6-bd59-97f958084162 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3" status: 200 len: 1265 microversion: 2.1 time: 0.149777 Jul 14 18:13:30.193080 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 642/1241] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:13:30 2022] GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:13:31.211273 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-7ee84701-862d-4f0d-9b2d-5fc47aed380b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:13:31.211997 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-7ee84701-862d-4f0d-9b2d-5fc47aed380b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:13:31.218268 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7ee84701-862d-4f0d-9b2d-5fc47aed380b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:13:31.218726 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7ee84701-862d-4f0d-9b2d-5fc47aed380b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:13:31.219496 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7ee84701-862d-4f0d-9b2d-5fc47aed380b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:13:31.219964 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7ee84701-862d-4f0d-9b2d-5fc47aed380b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:13:31.354916 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-7ee84701-862d-4f0d-9b2d-5fc47aed380b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:13:31.363348 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-7ee84701-862d-4f0d-9b2d-5fc47aed380b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3" status: 200 len: 1451 microversion: 2.1 time: 0.156787 Jul 14 18:13:31.363936 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 600/1242] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:13:31 2022] GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:13:31.379886 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-9f5d5630-7a16-4dc3-9004-e2004436233b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:13:31.380463 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-9f5d5630-7a16-4dc3-9004-e2004436233b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:13:31.386773 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9f5d5630-7a16-4dc3-9004-e2004436233b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:13:31.387226 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9f5d5630-7a16-4dc3-9004-e2004436233b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:13:31.388039 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9f5d5630-7a16-4dc3-9004-e2004436233b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:13:31.388483 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-9f5d5630-7a16-4dc3-9004-e2004436233b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:13:31.516885 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-9f5d5630-7a16-4dc3-9004-e2004436233b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:13:31.524777 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-9f5d5630-7a16-4dc3-9004-e2004436233b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3" status: 200 len: 1451 microversion: 2.1 time: 0.148973 Jul 14 18:13:31.525337 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 643/1243] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:13:31 2022] GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:13:33.188278 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-0125f6ef-a543-4f43-a20e-ca0a9d727601 req-60acfb35-3b67-4b3b-8005-d156ec0e678a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3", "tag": "aeb130e2-30d4-4356-a15c-d00104f9102e"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:13:33.196438 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-0125f6ef-a543-4f43-a20e-ca0a9d727601 req-60acfb35-3b67-4b3b-8005-d156ec0e678a service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:13:33.196884 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-0125f6ef-a543-4f43-a20e-ca0a9d727601 req-60acfb35-3b67-4b3b-8005-d156ec0e678a service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:13:33.208518 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-0125f6ef-a543-4f43-a20e-ca0a9d727601 req-60acfb35-3b67-4b3b-8005-d156ec0e678a service nova] Creating event network-changed:aeb130e2-30d4-4356-a15c-d00104f9102e for instance 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 on hv-cinder-84989 Jul 14 18:13:33.213409 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-0125f6ef-a543-4f43-a20e-ca0a9d727601 req-60acfb35-3b67-4b3b-8005-d156ec0e678a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090719 Jul 14 18:13:33.213999 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 601/1244] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:14:24.601397 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 18:14:24.602065 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Thu Jul 14 18:14:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 18:15:23.675629 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 18:15:23.676214 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Thu Jul 14 18:15:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 18:15:26.685817 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 18:15:26.686534 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Thu Jul 14 18:15:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 18:15:38.602519 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 18:15:38.603168 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Thu Jul 14 18:15:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 18:15:51.707632 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2b515744-0fb9-416f-9a78-2f5665e27f95] AMQP server on 10.222.0.64:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 14 18:15:51.708515 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_api:SELECT=20 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:15:51.709263 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=48 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:15:51.713474 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-093cfd11-30d0-4e5c-a8cd-a9fb067fea1a tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:15:51.713976 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-093cfd11-30d0-4e5c-a8cd-a9fb067fea1a tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:15:51.720766 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-093cfd11-30d0-4e5c-a8cd-a9fb067fea1a tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:15:51.721229 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-093cfd11-30d0-4e5c-a8cd-a9fb067fea1a tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:15:51.722001 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-093cfd11-30d0-4e5c-a8cd-a9fb067fea1a tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:15:51.722443 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-093cfd11-30d0-4e5c-a8cd-a9fb067fea1a tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:15:51.748334 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-093cfd11-30d0-4e5c-a8cd-a9fb067fea1a tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3] Going to try to terminate instance {{(pid=129471) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 18:15:51.831458 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-093cfd11-30d0-4e5c-a8cd-a9fb067fea1a tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "DELETE /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3" status: 204 len: 0 microversion: 2.1 time: 0.118865 Jul 14 18:15:51.831458 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 644/1245] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Jul 14 18:15:51 2022] DELETE /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 18:15:51.832741 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d2e1a42f-17fa-4fd5-a9d7-01a4b9db0ab5] AMQP server on 10.222.0.64:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 14 18:15:51.833658 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:15:51.834502 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=44 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:15:51.839507 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-ab5f38fa-ab32-4097-85e9-8014f0cfda7a tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:15:51.840109 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-ab5f38fa-ab32-4097-85e9-8014f0cfda7a tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:15:51.848889 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ab5f38fa-ab32-4097-85e9-8014f0cfda7a tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:15:51.849328 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ab5f38fa-ab32-4097-85e9-8014f0cfda7a tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:15:51.850103 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ab5f38fa-ab32-4097-85e9-8014f0cfda7a tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:15:51.850548 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-ab5f38fa-ab32-4097-85e9-8014f0cfda7a tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:15:51.983844 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-ab5f38fa-ab32-4097-85e9-8014f0cfda7a tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:15:51.992986 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-ab5f38fa-ab32-4097-85e9-8014f0cfda7a tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3" status: 200 len: 1575 microversion: 2.1 time: 0.162232 Jul 14 18:15:51.993583 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 602/1246] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:15:51 2022] GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:15:53.011234 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-a9b9c7ab-fa68-4585-891c-f2b222141f38 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:15:53.011968 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-a9b9c7ab-fa68-4585-891c-f2b222141f38 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:15:53.020101 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a9b9c7ab-fa68-4585-891c-f2b222141f38 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:15:53.020554 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a9b9c7ab-fa68-4585-891c-f2b222141f38 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:15:53.021328 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a9b9c7ab-fa68-4585-891c-f2b222141f38 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:15:53.021769 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a9b9c7ab-fa68-4585-891c-f2b222141f38 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:15:53.027839 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO oslo.messaging._drivers.impl_rabbit [-] [2b515744-0fb9-416f-9a78-2f5665e27f95] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 39464. Jul 14 18:15:53.152764 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-a9b9c7ab-fa68-4585-891c-f2b222141f38 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:15:53.160598 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-a9b9c7ab-fa68-4585-891c-f2b222141f38 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3" status: 200 len: 1575 microversion: 2.1 time: 0.153593 Jul 14 18:15:53.161168 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 645/1247] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:15:53 2022] GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:15:54.178264 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-45014bb5-bac7-442b-95c2-0845f5a913f6 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:15:54.178891 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-45014bb5-bac7-442b-95c2-0845f5a913f6 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:15:54.187914 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-45014bb5-bac7-442b-95c2-0845f5a913f6 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:15:54.188448 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-45014bb5-bac7-442b-95c2-0845f5a913f6 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:15:54.189170 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-45014bb5-bac7-442b-95c2-0845f5a913f6 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:15:54.189614 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-45014bb5-bac7-442b-95c2-0845f5a913f6 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:15:54.196661 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO oslo.messaging._drivers.impl_rabbit [-] [d2e1a42f-17fa-4fd5-a9d7-01a4b9db0ab5] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 39468. Jul 14 18:15:54.259830 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-45014bb5-bac7-442b-95c2-0845f5a913f6 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:15:54.268468 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-45014bb5-bac7-442b-95c2-0845f5a913f6 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3" status: 200 len: 1508 microversion: 2.1 time: 0.094110 Jul 14 18:15:54.269042 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 603/1248] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:15:54 2022] GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 => generated 1508 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:15:54.716800 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [req-57dacfa8-e48d-4efe-9cb7-cf36442de980 req-3038b1e9-fab2-49c1-b994-abdc1494e5e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3", "name": "network-vif-deleted", "tag": "aeb130e2-30d4-4356-a15c-d00104f9102e"}]} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:15:54.726123 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-57dacfa8-e48d-4efe-9cb7-cf36442de980 req-3038b1e9-fab2-49c1-b994-abdc1494e5e5 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:15:54.726575 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-57dacfa8-e48d-4efe-9cb7-cf36442de980 req-3038b1e9-fab2-49c1-b994-abdc1494e5e5 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:15:54.738004 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.compute.server_external_events [req-57dacfa8-e48d-4efe-9cb7-cf36442de980 req-3038b1e9-fab2-49c1-b994-abdc1494e5e5 service nova] Creating event network-vif-deleted:aeb130e2-30d4-4356-a15c-d00104f9102e for instance 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 on hv-cinder-84989 Jul 14 18:15:54.743505 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [req-57dacfa8-e48d-4efe-9cb7-cf36442de980 req-3038b1e9-fab2-49c1-b994-abdc1494e5e5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030967 Jul 14 18:15:54.744143 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 646/1249] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:15:55.285680 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-5e7d17f0-da98-4135-acb7-af1b0986ea4d tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:15:55.286240 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-5e7d17f0-da98-4135-acb7-af1b0986ea4d tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:15:55.292765 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5e7d17f0-da98-4135-acb7-af1b0986ea4d tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:15:55.293240 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5e7d17f0-da98-4135-acb7-af1b0986ea4d tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:15:55.294514 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5e7d17f0-da98-4135-acb7-af1b0986ea4d tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:15:55.294955 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5e7d17f0-da98-4135-acb7-af1b0986ea4d tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:15:55.329628 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5e7d17f0-da98-4135-acb7-af1b0986ea4d tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:15:55.330181 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5e7d17f0-da98-4135-acb7-af1b0986ea4d tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:15:55.330716 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.objects.instance [None req-5e7d17f0-da98-4135-acb7-af1b0986ea4d tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lazy-loading 'fault' on Instance uuid 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 {{(pid=129470) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 18:15:55.383501 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-5e7d17f0-da98-4135-acb7-af1b0986ea4d tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:15:55.391421 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-5e7d17f0-da98-4135-acb7-af1b0986ea4d tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3" status: 200 len: 1230 microversion: 2.1 time: 0.109692 Jul 14 18:15:55.392031 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 604/1250] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:15:55 2022] GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 => generated 1230 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:15:56.409936 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-d369ccb1-9820-464b-9f64-9452697107cb tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:15:56.410562 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-d369ccb1-9820-464b-9f64-9452697107cb tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:15:56.416821 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d369ccb1-9820-464b-9f64-9452697107cb tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:15:56.417274 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d369ccb1-9820-464b-9f64-9452697107cb tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:15:56.418046 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d369ccb1-9820-464b-9f64-9452697107cb tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:15:56.418643 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d369ccb1-9820-464b-9f64-9452697107cb tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:15:56.431573 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.wsgi [None req-d369ccb1-9820-464b-9f64-9452697107cb tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] HTTP exception thrown: Instance 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 could not be found. Jul 14 18:15:56.433211 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-d369ccb1-9820-464b-9f64-9452697107cb tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Request method failure captured: Jul 14 18:15:56.433211 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: request: GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 HTTP/1.1 Jul 14 18:15:56.433211 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept: application/json Jul 14 18:15:56.433211 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept-Encoding: identity Jul 14 18:15:56.433211 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Connection: close Jul 14 18:15:56.433211 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Length: 0 Jul 14 18:15:56.433211 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Type: application/json Jul 14 18:15:56.433211 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Host: 10.222.0.64 Jul 14 18:15:56.433211 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Openstack-System-Scope: None Jul 14 18:15:56.433211 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: User-Agent: python-urllib3/1.26.9 Jul 14 18:15:56.433211 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Auth-Token: gAAAAABi0Fydm_x9t_czjuOYcNiGD1oyYGG9f15NR9hKGssK_MbkkU7q2VkLd5an5hh9XMZatSPUPpRdHtBu-TZALYiIpfoGTNiaq4_YakfNT39VMb75su4fovx5O-c1Ae3zQ2VNICCu6jXQKImXh45XzksJYdJz8MWzbA70QsMRKZaDxquRP1k Jul 14 18:15:56.433211 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Id: None Jul 14 18:15:56.433211 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Name: None Jul 14 18:15:56.433211 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Identity-Status: Confirmed Jul 14 18:15:56.433211 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Is-Admin-Project: True Jul 14 18:15:56.433211 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Id: default Jul 14 18:15:56.433211 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Name: Default Jul 14 18:15:56.433211 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Id: 3a189153b8f44520a5bac2c4bcedc013 Jul 14 18:15:56.433211 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Name: tempest-TestVolumeBootPattern-11060473 Jul 14 18:15:56.433211 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Role: reader,member Jul 14 18:15:56.433211 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Roles: reader,member Jul 14 18:15:56.435975 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3a189153b8f44520a5bac2c4bcedc013"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3a189153b8f44520a5bac2c4bcedc013"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3a189153b8f44520a5bac2c4bcedc013"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3a189153b8f44520a5bac2c4bcedc013", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:15:56.435975 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant: tempest-TestVolumeBootPattern-11060473 Jul 14 18:15:56.435975 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Id: 3a189153b8f44520a5bac2c4bcedc013 Jul 14 18:15:56.435975 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Name: tempest-TestVolumeBootPattern-11060473 Jul 14 18:15:56.435975 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User: tempest-TestVolumeBootPattern-11060473-project Jul 14 18:15:56.435975 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Id: default Jul 14 18:15:56.435975 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Name: Default Jul 14 18:15:56.435975 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Id: 15d9d47d160b4595a16bf23eaa509a08 Jul 14 18:15:56.435975 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Name: tempest-TestVolumeBootPattern-11060473-project Jul 14 18:15:56.435975 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: method: > Jul 14 18:15:56.435975 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: exception: Instance 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 could not be found. Jul 14 18:15:56.435975 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: action_args: {'id': '5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3'} Jul 14 18:15:56.437074 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:15:56.437074 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:15:56.437074 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 18:15:56.437074 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 18:15:56.437074 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 18:15:56.437074 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 18:15:56.437074 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 18:15:56.437074 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 18:15:56.437074 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 18:15:56.437074 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 18:15:56.437074 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 could not be found. Jul 14 18:15:56.437074 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:15:56.437074 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:15:56.437074 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:15:56.437074 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:15:56.437074 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:15:56.437074 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:15:56.437074 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:15:56.437074 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:15:56.437074 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:15:56.438811 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:15:56.438811 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 18:15:56.438811 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 18:15:56.438811 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 18:15:56.438811 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 18:15:56.438811 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 18:15:56.438811 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 18:15:56.438811 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 could not be found. Jul 14 18:15:56.438811 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:15:56.438811 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:15:56.438811 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:15:56.438811 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:15:56.438811 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:15:56.438811 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:15:56.438811 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 18:15:56.438811 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 18:15:56.438811 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 could not be found. Jul 14 18:15:56.438811 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:15:56.440419 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-d369ccb1-9820-464b-9f64-9452697107cb tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Returning 404 to user: Instance 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 could not be found. {{(pid=129471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:15:56.440419 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-d369ccb1-9820-464b-9f64-9452697107cb tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3" status: 404 len: 111 microversion: 2.1 time: 0.029546 Jul 14 18:15:56.440419 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 647/1251] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:15:56 2022] GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 18:15:56.481192 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-9955093c-fca2-478e-832b-939c491e8cb5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-783903173", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1877107686", "security_groups": [{"name": "tempest-secgroup-smoke-355181516"}], "block_device_mapping_v2": [{"uuid": "d02e69b7-2f14-419e-848e-39c7437fed02", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0f1b18ec-16ad-4386-b70c-cceb4fb57ee1"}]}} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:15:56.591349 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.network.neutron [None req-9955093c-fca2-478e-832b-939c491e8cb5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] validate_networks() for [('0f1b18ec-16ad-4386-b70c-cceb4fb57ee1', None, None, None, None, None)] {{(pid=129470) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 18:15:56.967140 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-9955093c-fca2-478e-832b-939c491e8cb5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Flavor limits 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 18:15:56.967569 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-9955093c-fca2-478e-832b-939c491e8cb5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Image limits 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 18:15:56.968081 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-9955093c-fca2-478e-832b-939c491e8cb5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Flavor pref 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 18:15:56.968502 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-9955093c-fca2-478e-832b-939c491e8cb5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Image pref 0:0:0 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 18:15:56.968919 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.virt.hardware [None req-9955093c-fca2-478e-832b-939c491e8cb5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129470) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 18:15:56.977611 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9955093c-fca2-478e-832b-939c491e8cb5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:15:56.978061 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9955093c-fca2-478e-832b-939c491e8cb5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:15:56.978865 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9955093c-fca2-478e-832b-939c491e8cb5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:15:56.979307 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-9955093c-fca2-478e-832b-939c491e8cb5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:15:56.997695 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.quota [None req-9955093c-fca2-478e-832b-939c491e8cb5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Getting quotas for project 3a189153b8f44520a5bac2c4bcedc013. Resources: {'ram', 'cores', 'instances'} {{(pid=129470) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 18:15:57.001660 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.quota [None req-9955093c-fca2-478e-832b-939c491e8cb5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Getting quotas for user 15d9d47d160b4595a16bf23eaa509a08 and project 3a189153b8f44520a5bac2c4bcedc013. Resources: {'ram', 'cores', 'instances'} {{(pid=129470) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 18:15:57.058045 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-9955093c-fca2-478e-832b-939c491e8cb5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Going to run 1 instances... {{(pid=129470) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 18:15:57.060180 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-9955093c-fca2-478e-832b-939c491e8cb5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 86d54bfb-adec-469c-bb9e-f81824d88c2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d02e69b7-2f14-419e-848e-39c7437fed02',volume_size=None,volume_type=None)] {{(pid=129470) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 18:15:57.185807 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-9955093c-fca2-478e-832b-939c491e8cb5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.708469 Jul 14 18:15:57.186435 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 605/1252] 10.222.0.64 () {60 vars in 1146 bytes} [Thu Jul 14 18:15:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 18:15:57.196515 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-26f8f629-0910-4074-a4f0-4d815140fbc6 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:15:57.197230 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-26f8f629-0910-4074-a4f0-4d815140fbc6 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 86d54bfb-adec-469c-bb9e-f81824d88c2d] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:15:57.252876 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-26f8f629-0910-4074-a4f0-4d815140fbc6 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:15:57.259560 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-26f8f629-0910-4074-a4f0-4d815140fbc6 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d" status: 200 len: 1094 microversion: 2.1 time: 0.066948 Jul 14 18:15:57.260396 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 648/1253] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:15:57 2022] GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:15:58.277510 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-b545de8e-0ae5-4a46-96e4-07cc85039dd7 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:15:58.279011 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-b545de8e-0ae5-4a46-96e4-07cc85039dd7 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 86d54bfb-adec-469c-bb9e-f81824d88c2d] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:15:58.286849 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b545de8e-0ae5-4a46-96e4-07cc85039dd7 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:15:58.287309 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b545de8e-0ae5-4a46-96e4-07cc85039dd7 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:15:58.288117 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b545de8e-0ae5-4a46-96e4-07cc85039dd7 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:15:58.288559 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-b545de8e-0ae5-4a46-96e4-07cc85039dd7 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:15:58.351284 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-b545de8e-0ae5-4a46-96e4-07cc85039dd7 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:15:58.360068 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-b545de8e-0ae5-4a46-96e4-07cc85039dd7 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d" status: 200 len: 1200 microversion: 2.1 time: 0.086790 Jul 14 18:15:58.360642 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 606/1254] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:15:58 2022] GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d => generated 1200 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 18:15:59.378300 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-35d451f0-b66a-4543-a5bb-b2dd1244299d tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:15:59.378934 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-35d451f0-b66a-4543-a5bb-b2dd1244299d tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 86d54bfb-adec-469c-bb9e-f81824d88c2d] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:15:59.387083 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-35d451f0-b66a-4543-a5bb-b2dd1244299d tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:15:59.388074 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-35d451f0-b66a-4543-a5bb-b2dd1244299d tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:15:59.389825 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-35d451f0-b66a-4543-a5bb-b2dd1244299d tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:15:59.390265 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-35d451f0-b66a-4543-a5bb-b2dd1244299d tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:15:59.542761 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-35d451f0-b66a-4543-a5bb-b2dd1244299d tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:15:59.550820 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-35d451f0-b66a-4543-a5bb-b2dd1244299d tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d" status: 200 len: 1265 microversion: 2.1 time: 0.176736 Jul 14 18:15:59.551388 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 649/1255] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:15:59 2022] GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 18:15:59.648390 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-664509a7-8324-4beb-8f1d-40463b9a7657 req-945c1163-4bef-49fc-a15e-e1975070b40b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86d54bfb-adec-469c-bb9e-f81824d88c2d", "tag": "57218723-5ddf-4983-ab0c-3c02bbf3075b"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:15:59.670664 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-664509a7-8324-4beb-8f1d-40463b9a7657 req-945c1163-4bef-49fc-a15e-e1975070b40b service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:15:59.671111 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-664509a7-8324-4beb-8f1d-40463b9a7657 req-945c1163-4bef-49fc-a15e-e1975070b40b service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:15:59.688828 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-664509a7-8324-4beb-8f1d-40463b9a7657 req-945c1163-4bef-49fc-a15e-e1975070b40b service nova] Creating event network-changed:57218723-5ddf-4983-ab0c-3c02bbf3075b for instance 86d54bfb-adec-469c-bb9e-f81824d88c2d on hv-cinder-84989 Jul 14 18:15:59.694045 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-664509a7-8324-4beb-8f1d-40463b9a7657 req-945c1163-4bef-49fc-a15e-e1975070b40b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049478 Jul 14 18:15:59.694799 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 607/1256] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:16:00.567751 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-540bedc4-5b44-4e69-ac1c-90aa726f1e2f tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:16:00.568497 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-540bedc4-5b44-4e69-ac1c-90aa726f1e2f tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 86d54bfb-adec-469c-bb9e-f81824d88c2d] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:16:00.575036 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-540bedc4-5b44-4e69-ac1c-90aa726f1e2f tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:16:00.576077 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-540bedc4-5b44-4e69-ac1c-90aa726f1e2f tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:16:00.576909 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-540bedc4-5b44-4e69-ac1c-90aa726f1e2f tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:16:00.577358 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-540bedc4-5b44-4e69-ac1c-90aa726f1e2f tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:16:00.705616 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-540bedc4-5b44-4e69-ac1c-90aa726f1e2f tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:16:00.713193 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-540bedc4-5b44-4e69-ac1c-90aa726f1e2f tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d" status: 200 len: 1265 microversion: 2.1 time: 0.149262 Jul 14 18:16:00.713758 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 650/1257] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:16:00 2022] GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:16:01.730549 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-6679e39a-6527-4088-8633-f4122b04e69b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:16:01.731253 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-6679e39a-6527-4088-8633-f4122b04e69b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 86d54bfb-adec-469c-bb9e-f81824d88c2d] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:16:01.738154 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6679e39a-6527-4088-8633-f4122b04e69b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:16:01.738609 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6679e39a-6527-4088-8633-f4122b04e69b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:16:01.739389 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6679e39a-6527-4088-8633-f4122b04e69b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:16:01.739831 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-6679e39a-6527-4088-8633-f4122b04e69b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:16:01.872265 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-6679e39a-6527-4088-8633-f4122b04e69b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:16:01.879658 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-6679e39a-6527-4088-8633-f4122b04e69b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d" status: 200 len: 1265 microversion: 2.1 time: 0.153830 Jul 14 18:16:01.880268 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 608/1258] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:16:01 2022] GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:16:02.897152 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-8f7e8217-5c96-4c75-ae49-6139b507327c tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:16:02.897757 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-8f7e8217-5c96-4c75-ae49-6139b507327c tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 86d54bfb-adec-469c-bb9e-f81824d88c2d] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:16:02.904980 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8f7e8217-5c96-4c75-ae49-6139b507327c tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:16:02.905427 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8f7e8217-5c96-4c75-ae49-6139b507327c tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:16:02.906193 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8f7e8217-5c96-4c75-ae49-6139b507327c tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:16:02.906632 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8f7e8217-5c96-4c75-ae49-6139b507327c tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:16:03.036660 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-8f7e8217-5c96-4c75-ae49-6139b507327c tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:16:03.044153 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-8f7e8217-5c96-4c75-ae49-6139b507327c tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d" status: 200 len: 1265 microversion: 2.1 time: 0.150991 Jul 14 18:16:03.047978 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 651/1259] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:16:02 2022] GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 18:16:04.061804 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-8897a447-e974-4348-8f19-d6b6aa9f1103 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:16:04.062430 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-8897a447-e974-4348-8f19-d6b6aa9f1103 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 86d54bfb-adec-469c-bb9e-f81824d88c2d] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:16:04.069117 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8897a447-e974-4348-8f19-d6b6aa9f1103 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:16:04.069581 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8897a447-e974-4348-8f19-d6b6aa9f1103 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:16:04.070367 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8897a447-e974-4348-8f19-d6b6aa9f1103 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:16:04.070808 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-8897a447-e974-4348-8f19-d6b6aa9f1103 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:16:04.203603 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-8897a447-e974-4348-8f19-d6b6aa9f1103 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:16:04.211105 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-8897a447-e974-4348-8f19-d6b6aa9f1103 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d" status: 200 len: 1265 microversion: 2.1 time: 0.153813 Jul 14 18:16:04.211672 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 609/1260] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:16:04 2022] GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:16:05.227020 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-c8bcb6b4-c21e-416d-a7aa-76cab2fba27c tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:16:05.227604 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-c8bcb6b4-c21e-416d-a7aa-76cab2fba27c tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 86d54bfb-adec-469c-bb9e-f81824d88c2d] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:16:05.234808 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c8bcb6b4-c21e-416d-a7aa-76cab2fba27c tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:16:05.235251 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c8bcb6b4-c21e-416d-a7aa-76cab2fba27c tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:16:05.236039 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c8bcb6b4-c21e-416d-a7aa-76cab2fba27c tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:16:05.236490 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-c8bcb6b4-c21e-416d-a7aa-76cab2fba27c tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:16:05.588868 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-c8bcb6b4-c21e-416d-a7aa-76cab2fba27c tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:16:05.596949 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-c8bcb6b4-c21e-416d-a7aa-76cab2fba27c tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d" status: 200 len: 1265 microversion: 2.1 time: 0.373736 Jul 14 18:16:05.597473 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 652/1261] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:16:05 2022] GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d => generated 1265 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:16:06.613674 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-5f44293c-7a4c-4ecf-9f34-301e3939e0de tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:16:06.614289 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-5f44293c-7a4c-4ecf-9f34-301e3939e0de tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 86d54bfb-adec-469c-bb9e-f81824d88c2d] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:16:06.620876 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5f44293c-7a4c-4ecf-9f34-301e3939e0de tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:16:06.621330 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5f44293c-7a4c-4ecf-9f34-301e3939e0de tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:16:06.622092 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5f44293c-7a4c-4ecf-9f34-301e3939e0de tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:16:06.622552 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5f44293c-7a4c-4ecf-9f34-301e3939e0de tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:16:06.751406 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-5f44293c-7a4c-4ecf-9f34-301e3939e0de tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:16:06.758853 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-5f44293c-7a4c-4ecf-9f34-301e3939e0de tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d" status: 200 len: 1265 microversion: 2.1 time: 0.149089 Jul 14 18:16:06.759431 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 610/1262] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:16:06 2022] GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:16:07.776378 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-8b5f993d-d602-43a5-9525-1d9c26540c9f tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:16:07.777035 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-8b5f993d-d602-43a5-9525-1d9c26540c9f tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 86d54bfb-adec-469c-bb9e-f81824d88c2d] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:16:07.779891 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell0:SELECT=2 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:16:07.785604 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8b5f993d-d602-43a5-9525-1d9c26540c9f tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:16:07.786056 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8b5f993d-d602-43a5-9525-1d9c26540c9f tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:16:07.786827 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8b5f993d-d602-43a5-9525-1d9c26540c9f tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:16:07.787469 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8b5f993d-d602-43a5-9525-1d9c26540c9f tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:16:07.921670 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-8b5f993d-d602-43a5-9525-1d9c26540c9f tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:16:07.929129 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-8b5f993d-d602-43a5-9525-1d9c26540c9f tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d" status: 200 len: 1265 microversion: 2.1 time: 0.156640 Jul 14 18:16:07.929693 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 653/1263] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:16:07 2022] GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:16:08.946468 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-11a9b746-302f-4f3a-ac92-bd3cb4dfc92b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:16:08.947077 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-11a9b746-302f-4f3a-ac92-bd3cb4dfc92b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 86d54bfb-adec-469c-bb9e-f81824d88c2d] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:16:08.949107 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell0:SELECT=2 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:16:08.949982 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell0:SELECT=6 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:16:08.956521 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-11a9b746-302f-4f3a-ac92-bd3cb4dfc92b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:16:08.956967 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-11a9b746-302f-4f3a-ac92-bd3cb4dfc92b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:16:08.957759 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-11a9b746-302f-4f3a-ac92-bd3cb4dfc92b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:16:08.958242 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-11a9b746-302f-4f3a-ac92-bd3cb4dfc92b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:16:09.090910 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-11a9b746-302f-4f3a-ac92-bd3cb4dfc92b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:16:09.098512 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-11a9b746-302f-4f3a-ac92-bd3cb4dfc92b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d" status: 200 len: 1265 microversion: 2.1 time: 0.155932 Jul 14 18:16:09.099116 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 611/1264] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:16:08 2022] GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:16:10.115737 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-696c7a5b-b39f-43d2-9931-dc1ccebd1318 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:16:10.116392 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-696c7a5b-b39f-43d2-9931-dc1ccebd1318 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 86d54bfb-adec-469c-bb9e-f81824d88c2d] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:16:10.123065 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-696c7a5b-b39f-43d2-9931-dc1ccebd1318 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:16:10.123513 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-696c7a5b-b39f-43d2-9931-dc1ccebd1318 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:16:10.124326 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-696c7a5b-b39f-43d2-9931-dc1ccebd1318 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:16:10.124767 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-696c7a5b-b39f-43d2-9931-dc1ccebd1318 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:16:10.255190 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-696c7a5b-b39f-43d2-9931-dc1ccebd1318 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:16:10.263188 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-696c7a5b-b39f-43d2-9931-dc1ccebd1318 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d" status: 200 len: 1265 microversion: 2.1 time: 0.151279 Jul 14 18:16:10.263747 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 654/1265] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:16:10 2022] GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:16:11.280202 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-fa6b13e1-9c66-4019-bc2e-7fd294b01eb8 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:16:11.280836 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-fa6b13e1-9c66-4019-bc2e-7fd294b01eb8 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 86d54bfb-adec-469c-bb9e-f81824d88c2d] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:16:11.287331 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fa6b13e1-9c66-4019-bc2e-7fd294b01eb8 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:16:11.287780 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fa6b13e1-9c66-4019-bc2e-7fd294b01eb8 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:16:11.288586 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fa6b13e1-9c66-4019-bc2e-7fd294b01eb8 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:16:11.289031 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-fa6b13e1-9c66-4019-bc2e-7fd294b01eb8 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:16:11.417231 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-fa6b13e1-9c66-4019-bc2e-7fd294b01eb8 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:16:11.425066 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-fa6b13e1-9c66-4019-bc2e-7fd294b01eb8 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d" status: 200 len: 1265 microversion: 2.1 time: 0.148736 Jul 14 18:16:11.425833 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 612/1266] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:16:11 2022] GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:16:12.006334 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [req-c5eeb69f-51b2-4c4e-a074-28e73ae28005 req-e6083752-7c5a-47e0-8f2e-68d08e76a80e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86d54bfb-adec-469c-bb9e-f81824d88c2d", "name": "network-vif-plugged", "status": "completed", "tag": "57218723-5ddf-4983-ab0c-3c02bbf3075b"}]} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:16:12.019463 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-c5eeb69f-51b2-4c4e-a074-28e73ae28005 req-e6083752-7c5a-47e0-8f2e-68d08e76a80e service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:16:12.019917 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-c5eeb69f-51b2-4c4e-a074-28e73ae28005 req-e6083752-7c5a-47e0-8f2e-68d08e76a80e service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:16:12.031192 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.compute.server_external_events [req-c5eeb69f-51b2-4c4e-a074-28e73ae28005 req-e6083752-7c5a-47e0-8f2e-68d08e76a80e service nova] Creating event network-vif-plugged:57218723-5ddf-4983-ab0c-3c02bbf3075b for instance 86d54bfb-adec-469c-bb9e-f81824d88c2d on hv-cinder-84989 Jul 14 18:16:12.036401 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [req-c5eeb69f-51b2-4c4e-a074-28e73ae28005 req-e6083752-7c5a-47e0-8f2e-68d08e76a80e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091620 Jul 14 18:16:12.036895 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 655/1267] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 18:16:12.442272 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-db93794e-c7e8-4436-a84b-258e758826ad tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:16:12.442911 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-db93794e-c7e8-4436-a84b-258e758826ad tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 86d54bfb-adec-469c-bb9e-f81824d88c2d] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:16:12.449484 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-db93794e-c7e8-4436-a84b-258e758826ad tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:16:12.449943 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-db93794e-c7e8-4436-a84b-258e758826ad tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:16:12.450709 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-db93794e-c7e8-4436-a84b-258e758826ad tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:16:12.451648 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-db93794e-c7e8-4436-a84b-258e758826ad tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:16:12.582871 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-db93794e-c7e8-4436-a84b-258e758826ad tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:16:12.590346 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-db93794e-c7e8-4436-a84b-258e758826ad tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d" status: 200 len: 1265 microversion: 2.1 time: 0.151990 Jul 14 18:16:12.590914 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 613/1268] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:16:12 2022] GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:16:13.609508 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-75e5718a-682b-40ee-a78f-e5b633198530 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:16:13.610210 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-75e5718a-682b-40ee-a78f-e5b633198530 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 86d54bfb-adec-469c-bb9e-f81824d88c2d] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:16:13.616474 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-75e5718a-682b-40ee-a78f-e5b633198530 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:16:13.616933 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-75e5718a-682b-40ee-a78f-e5b633198530 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:16:13.617703 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-75e5718a-682b-40ee-a78f-e5b633198530 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:16:13.618147 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-75e5718a-682b-40ee-a78f-e5b633198530 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:16:13.750319 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-75e5718a-682b-40ee-a78f-e5b633198530 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:16:13.759534 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-75e5718a-682b-40ee-a78f-e5b633198530 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d" status: 200 len: 1265 microversion: 2.1 time: 0.154941 Jul 14 18:16:13.760129 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 656/1269] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:16:13 2022] GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:16:14.776952 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-e8d1408e-8e51-4997-be82-527a9304eb00 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:16:14.777572 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-e8d1408e-8e51-4997-be82-527a9304eb00 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 86d54bfb-adec-469c-bb9e-f81824d88c2d] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:16:14.784821 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e8d1408e-8e51-4997-be82-527a9304eb00 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:16:14.785280 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e8d1408e-8e51-4997-be82-527a9304eb00 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:16:14.786065 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e8d1408e-8e51-4997-be82-527a9304eb00 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:16:14.786503 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-e8d1408e-8e51-4997-be82-527a9304eb00 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:16:14.914182 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-e8d1408e-8e51-4997-be82-527a9304eb00 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:16:14.921743 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-e8d1408e-8e51-4997-be82-527a9304eb00 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d" status: 200 len: 1452 microversion: 2.1 time: 0.148756 Jul 14 18:16:14.922317 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 614/1270] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:16:14 2022] GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:16:14.938048 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-b2342597-40e3-43bb-abc3-5ed61d94f041 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:16:14.938665 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-b2342597-40e3-43bb-abc3-5ed61d94f041 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 86d54bfb-adec-469c-bb9e-f81824d88c2d] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:16:14.945353 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b2342597-40e3-43bb-abc3-5ed61d94f041 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:16:14.945799 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b2342597-40e3-43bb-abc3-5ed61d94f041 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:16:14.946564 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b2342597-40e3-43bb-abc3-5ed61d94f041 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:16:14.947000 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-b2342597-40e3-43bb-abc3-5ed61d94f041 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:16:15.080361 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-b2342597-40e3-43bb-abc3-5ed61d94f041 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:16:15.088079 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-b2342597-40e3-43bb-abc3-5ed61d94f041 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d" status: 200 len: 1452 microversion: 2.1 time: 0.154311 Jul 14 18:16:15.088657 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 657/1271] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:16:14 2022] GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:16:16.667510 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-516222e7-ec34-4a29-a88b-45dc8297dc47 req-5f4eae36-2667-4def-bf6b-4c1877861285 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86d54bfb-adec-469c-bb9e-f81824d88c2d", "tag": "57218723-5ddf-4983-ab0c-3c02bbf3075b"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:16:16.677183 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-516222e7-ec34-4a29-a88b-45dc8297dc47 req-5f4eae36-2667-4def-bf6b-4c1877861285 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:16:16.677631 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-516222e7-ec34-4a29-a88b-45dc8297dc47 req-5f4eae36-2667-4def-bf6b-4c1877861285 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:16:16.688820 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-516222e7-ec34-4a29-a88b-45dc8297dc47 req-5f4eae36-2667-4def-bf6b-4c1877861285 service nova] Creating event network-changed:57218723-5ddf-4983-ab0c-3c02bbf3075b for instance 86d54bfb-adec-469c-bb9e-f81824d88c2d on hv-cinder-84989 Jul 14 18:16:16.694106 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-516222e7-ec34-4a29-a88b-45dc8297dc47 req-5f4eae36-2667-4def-bf6b-4c1877861285 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030254 Jul 14 18:16:16.694684 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 615/1272] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:17:08.855052 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 18:17:08.855799 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Thu Jul 14 18:17:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 18:18:17.672032 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:18:17.672880 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:18:17.677802 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-0ebba2c5-5d2b-4b04-903a-e63d788474dd tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-839600682", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1877107686", "security_groups": [{"name": "tempest-secgroup-smoke-355181516"}], "block_device_mapping_v2": [{"uuid": "5e9825e8-9682-4e49-8789-0d271e044507", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0f1b18ec-16ad-4386-b70c-cceb4fb57ee1"}]}} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:18:17.838968 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.network.neutron [None req-0ebba2c5-5d2b-4b04-903a-e63d788474dd tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] validate_networks() for [('0f1b18ec-16ad-4386-b70c-cceb4fb57ee1', None, None, None, None, None)] {{(pid=129471) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 18:18:18.248471 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-0ebba2c5-5d2b-4b04-903a-e63d788474dd tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Flavor limits 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 18:18:18.248899 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-0ebba2c5-5d2b-4b04-903a-e63d788474dd tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Image limits 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 18:18:18.249377 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-0ebba2c5-5d2b-4b04-903a-e63d788474dd tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Flavor pref 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 18:18:18.249788 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-0ebba2c5-5d2b-4b04-903a-e63d788474dd tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Image pref 0:0:0 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 18:18:18.250201 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.virt.hardware [None req-0ebba2c5-5d2b-4b04-903a-e63d788474dd tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 18:18:18.259211 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0ebba2c5-5d2b-4b04-903a-e63d788474dd tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:18:18.259660 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0ebba2c5-5d2b-4b04-903a-e63d788474dd tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:18:18.260498 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0ebba2c5-5d2b-4b04-903a-e63d788474dd tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:18:18.260938 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-0ebba2c5-5d2b-4b04-903a-e63d788474dd tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:18:18.278808 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.quota [None req-0ebba2c5-5d2b-4b04-903a-e63d788474dd tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Getting quotas for project 3a189153b8f44520a5bac2c4bcedc013. Resources: {'ram', 'cores', 'instances'} {{(pid=129471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 18:18:18.282727 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.quota [None req-0ebba2c5-5d2b-4b04-903a-e63d788474dd tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Getting quotas for user 15d9d47d160b4595a16bf23eaa509a08 and project 3a189153b8f44520a5bac2c4bcedc013. Resources: {'ram', 'cores', 'instances'} {{(pid=129471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 18:18:18.338864 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-0ebba2c5-5d2b-4b04-903a-e63d788474dd tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Going to run 1 instances... {{(pid=129471) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 18:18:18.341010 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-0ebba2c5-5d2b-4b04-903a-e63d788474dd tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5ddfb4cb-657b-4b17-9272-6e8f69beef1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5e9825e8-9682-4e49-8789-0d271e044507',volume_size=None,volume_type=None)] {{(pid=129471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 18:18:18.469608 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-0ebba2c5-5d2b-4b04-903a-e63d788474dd tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.799406 Jul 14 18:18:18.470266 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 658/1273] 10.222.0.64 () {60 vars in 1146 bytes} [Thu Jul 14 18:18:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 18:18:18.490296 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:18:18.491480 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=74 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:18:18.496045 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-82d4e5f3-3eee-4b97-83f4-aab4bccfb756 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:18:18.496752 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-82d4e5f3-3eee-4b97-83f4-aab4bccfb756 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5ddfb4cb-657b-4b17-9272-6e8f69beef1d] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:18:18.599838 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-82d4e5f3-3eee-4b97-83f4-aab4bccfb756 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:18:18.606591 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-82d4e5f3-3eee-4b97-83f4-aab4bccfb756 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d" status: 200 len: 1094 microversion: 2.1 time: 0.130087 Jul 14 18:18:18.607153 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 616/1274] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:18:18 2022] GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d => generated 1094 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:18:19.623652 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-53a2d07b-20f5-4839-95f5-df67989052f0 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:18:19.624446 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-53a2d07b-20f5-4839-95f5-df67989052f0 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5ddfb4cb-657b-4b17-9272-6e8f69beef1d] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:18:19.631736 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-53a2d07b-20f5-4839-95f5-df67989052f0 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:18:19.632221 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-53a2d07b-20f5-4839-95f5-df67989052f0 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:18:19.633029 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-53a2d07b-20f5-4839-95f5-df67989052f0 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:18:19.633471 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-53a2d07b-20f5-4839-95f5-df67989052f0 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:18:19.695056 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-53a2d07b-20f5-4839-95f5-df67989052f0 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:18:19.702511 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-53a2d07b-20f5-4839-95f5-df67989052f0 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d" status: 200 len: 1210 microversion: 2.1 time: 0.083276 Jul 14 18:18:19.703088 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 659/1275] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:18:19 2022] GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d => generated 1210 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:18:20.720932 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-78e4adc5-218b-462a-b790-6c295a6e6e37 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:18:20.721647 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-78e4adc5-218b-462a-b790-6c295a6e6e37 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5ddfb4cb-657b-4b17-9272-6e8f69beef1d] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:18:20.730118 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-78e4adc5-218b-462a-b790-6c295a6e6e37 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:18:20.730430 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-78e4adc5-218b-462a-b790-6c295a6e6e37 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:18:20.731224 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-78e4adc5-218b-462a-b790-6c295a6e6e37 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:18:20.731960 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-78e4adc5-218b-462a-b790-6c295a6e6e37 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:18:20.903132 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-78e4adc5-218b-462a-b790-6c295a6e6e37 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:18:20.914047 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-78e4adc5-218b-462a-b790-6c295a6e6e37 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d" status: 200 len: 1265 microversion: 2.1 time: 0.197440 Jul 14 18:18:20.917507 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 617/1276] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:18:20 2022] GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:18:20.958198 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [req-8391becb-f437-43c7-b49a-16c9dff6c138 req-4528587a-244b-471a-853c-fa4823f6f6ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ddfb4cb-657b-4b17-9272-6e8f69beef1d", "tag": "effae01c-879e-45a0-a940-7f1c3027baf9"}]} {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:18:20.971163 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-8391becb-f437-43c7-b49a-16c9dff6c138 req-4528587a-244b-471a-853c-fa4823f6f6ed service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:18:20.972192 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [req-8391becb-f437-43c7-b49a-16c9dff6c138 req-4528587a-244b-471a-853c-fa4823f6f6ed service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:18:20.985420 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.compute.server_external_events [req-8391becb-f437-43c7-b49a-16c9dff6c138 req-4528587a-244b-471a-853c-fa4823f6f6ed service nova] Creating event network-changed:effae01c-879e-45a0-a940-7f1c3027baf9 for instance 5ddfb4cb-657b-4b17-9272-6e8f69beef1d on hv-cinder-84989 Jul 14 18:18:20.990762 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [req-8391becb-f437-43c7-b49a-16c9dff6c138 req-4528587a-244b-471a-853c-fa4823f6f6ed service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115772 Jul 14 18:18:20.991766 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 660/1277] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 18:18:21.932644 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-75fcc4de-5643-47af-94d7-2c6885ef96da tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:18:21.933258 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-75fcc4de-5643-47af-94d7-2c6885ef96da tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5ddfb4cb-657b-4b17-9272-6e8f69beef1d] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:18:21.940562 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-75fcc4de-5643-47af-94d7-2c6885ef96da tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:18:21.941019 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-75fcc4de-5643-47af-94d7-2c6885ef96da tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:18:21.941788 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-75fcc4de-5643-47af-94d7-2c6885ef96da tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:18:21.942231 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-75fcc4de-5643-47af-94d7-2c6885ef96da tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:18:22.073048 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-75fcc4de-5643-47af-94d7-2c6885ef96da tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:18:22.080549 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-75fcc4de-5643-47af-94d7-2c6885ef96da tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d" status: 200 len: 1265 microversion: 2.1 time: 0.152063 Jul 14 18:18:22.081126 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 618/1278] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:18:21 2022] GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:18:23.098135 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-a0216a2e-f5dc-4adb-963b-b06fa584a15c tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:18:23.098874 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-a0216a2e-f5dc-4adb-963b-b06fa584a15c tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5ddfb4cb-657b-4b17-9272-6e8f69beef1d] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:18:23.105410 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a0216a2e-f5dc-4adb-963b-b06fa584a15c tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:18:23.105631 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a0216a2e-f5dc-4adb-963b-b06fa584a15c tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:18:23.106521 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a0216a2e-f5dc-4adb-963b-b06fa584a15c tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:18:23.106976 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-a0216a2e-f5dc-4adb-963b-b06fa584a15c tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:18:23.235434 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-a0216a2e-f5dc-4adb-963b-b06fa584a15c tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:18:23.243424 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-a0216a2e-f5dc-4adb-963b-b06fa584a15c tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d" status: 200 len: 1265 microversion: 2.1 time: 0.149996 Jul 14 18:18:23.244004 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 661/1279] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:18:23 2022] GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:18:24.261294 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-a5cf9f86-8f9f-4f1f-a8c1-137e9f744d5e tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:18:24.261916 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-a5cf9f86-8f9f-4f1f-a8c1-137e9f744d5e tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5ddfb4cb-657b-4b17-9272-6e8f69beef1d] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:18:24.268230 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a5cf9f86-8f9f-4f1f-a8c1-137e9f744d5e tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:18:24.268689 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a5cf9f86-8f9f-4f1f-a8c1-137e9f744d5e tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:18:24.269460 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a5cf9f86-8f9f-4f1f-a8c1-137e9f744d5e tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:18:24.269901 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-a5cf9f86-8f9f-4f1f-a8c1-137e9f744d5e tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:18:24.401265 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-a5cf9f86-8f9f-4f1f-a8c1-137e9f744d5e tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:18:24.409283 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-a5cf9f86-8f9f-4f1f-a8c1-137e9f744d5e tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d" status: 200 len: 1265 microversion: 2.1 time: 0.151982 Jul 14 18:18:24.409852 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 619/1280] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:18:24 2022] GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:18:25.426564 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-fa4d48fa-4227-4345-8dde-86e7074484b3 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:18:25.427114 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-fa4d48fa-4227-4345-8dde-86e7074484b3 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5ddfb4cb-657b-4b17-9272-6e8f69beef1d] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:18:25.433606 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fa4d48fa-4227-4345-8dde-86e7074484b3 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:18:25.434057 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fa4d48fa-4227-4345-8dde-86e7074484b3 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:18:25.434827 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fa4d48fa-4227-4345-8dde-86e7074484b3 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:18:25.435266 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-fa4d48fa-4227-4345-8dde-86e7074484b3 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:18:25.562324 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-fa4d48fa-4227-4345-8dde-86e7074484b3 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:18:25.569784 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-fa4d48fa-4227-4345-8dde-86e7074484b3 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d" status: 200 len: 1265 microversion: 2.1 time: 0.147736 Jul 14 18:18:25.570349 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 662/1281] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:18:25 2022] GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:18:26.586520 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-7302f616-2ab1-4450-8fdf-7a8adb2fc0cf tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:18:26.587122 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-7302f616-2ab1-4450-8fdf-7a8adb2fc0cf tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5ddfb4cb-657b-4b17-9272-6e8f69beef1d] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:18:26.593662 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7302f616-2ab1-4450-8fdf-7a8adb2fc0cf tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:18:26.594114 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7302f616-2ab1-4450-8fdf-7a8adb2fc0cf tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:18:26.595372 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7302f616-2ab1-4450-8fdf-7a8adb2fc0cf tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:18:26.595807 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-7302f616-2ab1-4450-8fdf-7a8adb2fc0cf tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:18:26.725334 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-7302f616-2ab1-4450-8fdf-7a8adb2fc0cf tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:18:26.732840 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-7302f616-2ab1-4450-8fdf-7a8adb2fc0cf tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d" status: 200 len: 1265 microversion: 2.1 time: 0.150248 Jul 14 18:18:26.733404 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 620/1282] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:18:26 2022] GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:18:27.750116 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-baa7c35b-9b4b-4187-ba5d-0817391248b5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:18:27.750793 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-baa7c35b-9b4b-4187-ba5d-0817391248b5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5ddfb4cb-657b-4b17-9272-6e8f69beef1d] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:18:27.757549 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-baa7c35b-9b4b-4187-ba5d-0817391248b5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:18:27.758031 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-baa7c35b-9b4b-4187-ba5d-0817391248b5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:18:27.758792 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-baa7c35b-9b4b-4187-ba5d-0817391248b5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:18:27.759240 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-baa7c35b-9b4b-4187-ba5d-0817391248b5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:18:27.889368 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-baa7c35b-9b4b-4187-ba5d-0817391248b5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:18:27.897222 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-baa7c35b-9b4b-4187-ba5d-0817391248b5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d" status: 200 len: 1265 microversion: 2.1 time: 0.150978 Jul 14 18:18:27.897788 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 663/1283] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:18:27 2022] GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 18:18:28.913813 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-539711c9-1dee-450a-9404-d5d8ca56bf78 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:18:28.914358 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-539711c9-1dee-450a-9404-d5d8ca56bf78 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5ddfb4cb-657b-4b17-9272-6e8f69beef1d] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:18:28.916747 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell0:SELECT=2 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:18:28.922345 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-539711c9-1dee-450a-9404-d5d8ca56bf78 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:18:28.923437 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-539711c9-1dee-450a-9404-d5d8ca56bf78 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:18:28.924235 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-539711c9-1dee-450a-9404-d5d8ca56bf78 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:18:28.924679 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-539711c9-1dee-450a-9404-d5d8ca56bf78 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:18:29.050753 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-539711c9-1dee-450a-9404-d5d8ca56bf78 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:18:29.058261 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-539711c9-1dee-450a-9404-d5d8ca56bf78 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d" status: 200 len: 1265 microversion: 2.1 time: 0.148396 Jul 14 18:18:29.058856 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 621/1284] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:18:28 2022] GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:18:30.074694 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-f4b8dfc4-946f-4a1a-9286-77fb3d46e35f tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:18:30.075310 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-f4b8dfc4-946f-4a1a-9286-77fb3d46e35f tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5ddfb4cb-657b-4b17-9272-6e8f69beef1d] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:18:30.077269 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell0:SELECT=2 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:18:30.077930 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell0:SELECT=6 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:18:30.084380 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f4b8dfc4-946f-4a1a-9286-77fb3d46e35f tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:18:30.084833 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f4b8dfc4-946f-4a1a-9286-77fb3d46e35f tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:18:30.085598 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f4b8dfc4-946f-4a1a-9286-77fb3d46e35f tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:18:30.086041 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-f4b8dfc4-946f-4a1a-9286-77fb3d46e35f tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:18:30.217298 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-f4b8dfc4-946f-4a1a-9286-77fb3d46e35f tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:18:30.224758 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-f4b8dfc4-946f-4a1a-9286-77fb3d46e35f tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d" status: 200 len: 1265 microversion: 2.1 time: 0.153957 Jul 14 18:18:30.225328 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 664/1285] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:18:30 2022] GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:18:31.242301 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-04f8e3f8-d972-4b02-b9e1-0dcdfe693d21 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:18:31.242920 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-04f8e3f8-d972-4b02-b9e1-0dcdfe693d21 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5ddfb4cb-657b-4b17-9272-6e8f69beef1d] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:18:31.249338 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-04f8e3f8-d972-4b02-b9e1-0dcdfe693d21 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:18:31.249795 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-04f8e3f8-d972-4b02-b9e1-0dcdfe693d21 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:18:31.251061 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-04f8e3f8-d972-4b02-b9e1-0dcdfe693d21 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:18:31.251501 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-04f8e3f8-d972-4b02-b9e1-0dcdfe693d21 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:18:31.378957 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-04f8e3f8-d972-4b02-b9e1-0dcdfe693d21 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:18:31.386764 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-04f8e3f8-d972-4b02-b9e1-0dcdfe693d21 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d" status: 200 len: 1265 microversion: 2.1 time: 0.148349 Jul 14 18:18:31.387333 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 622/1286] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:18:31 2022] GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:18:32.404086 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-aa0932cb-3548-45e8-a191-176227b904c0 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:18:32.404626 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-aa0932cb-3548-45e8-a191-176227b904c0 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5ddfb4cb-657b-4b17-9272-6e8f69beef1d] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:18:32.411695 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-aa0932cb-3548-45e8-a191-176227b904c0 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:18:32.412169 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-aa0932cb-3548-45e8-a191-176227b904c0 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:18:32.412921 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-aa0932cb-3548-45e8-a191-176227b904c0 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:18:32.413352 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-aa0932cb-3548-45e8-a191-176227b904c0 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:18:32.545055 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-aa0932cb-3548-45e8-a191-176227b904c0 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:18:32.552885 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-aa0932cb-3548-45e8-a191-176227b904c0 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d" status: 200 len: 1265 microversion: 2.1 time: 0.152728 Jul 14 18:18:32.553452 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 665/1287] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:18:32 2022] GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:18:32.716735 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-dbaadf2f-a19e-4ae8-8912-8f08faa6faa5 req-b6087f0e-1a69-4370-b968-5923b1c37a5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ddfb4cb-657b-4b17-9272-6e8f69beef1d", "name": "network-vif-plugged", "status": "completed", "tag": "effae01c-879e-45a0-a940-7f1c3027baf9"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:18:32.726091 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-dbaadf2f-a19e-4ae8-8912-8f08faa6faa5 req-b6087f0e-1a69-4370-b968-5923b1c37a5f service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:18:32.726546 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-dbaadf2f-a19e-4ae8-8912-8f08faa6faa5 req-b6087f0e-1a69-4370-b968-5923b1c37a5f service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:18:32.737518 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-dbaadf2f-a19e-4ae8-8912-8f08faa6faa5 req-b6087f0e-1a69-4370-b968-5923b1c37a5f service nova] Creating event network-vif-plugged:effae01c-879e-45a0-a940-7f1c3027baf9 for instance 5ddfb4cb-657b-4b17-9272-6e8f69beef1d on hv-cinder-84989 Jul 14 18:18:32.741127 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR oslo.messaging._drivers.impl_rabbit [req-dbaadf2f-a19e-4ae8-8912-8f08faa6faa5 req-b6087f0e-1a69-4370-b968-5923b1c37a5f service nova] [d8f93339-6202-43cd-9162-a20a413deb34] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 18:18:33.569620 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-8739a719-c7b0-48ea-a941-9b49b910403b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:18:33.570229 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-8739a719-c7b0-48ea-a941-9b49b910403b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5ddfb4cb-657b-4b17-9272-6e8f69beef1d] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:18:33.576702 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8739a719-c7b0-48ea-a941-9b49b910403b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:18:33.577148 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8739a719-c7b0-48ea-a941-9b49b910403b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:18:33.577902 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8739a719-c7b0-48ea-a941-9b49b910403b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:18:33.578334 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-8739a719-c7b0-48ea-a941-9b49b910403b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:18:33.704731 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-8739a719-c7b0-48ea-a941-9b49b910403b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:18:33.712081 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-8739a719-c7b0-48ea-a941-9b49b910403b tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d" status: 200 len: 1265 microversion: 2.1 time: 0.146288 Jul 14 18:18:33.712643 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 666/1288] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:18:33 2022] GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 18:18:33.748301 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO oslo.messaging._drivers.impl_rabbit [req-dbaadf2f-a19e-4ae8-8912-8f08faa6faa5 req-b6087f0e-1a69-4370-b968-5923b1c37a5f service nova] [d8f93339-6202-43cd-9162-a20a413deb34] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 39690. Jul 14 18:18:33.751629 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-dbaadf2f-a19e-4ae8-8912-8f08faa6faa5 req-b6087f0e-1a69-4370-b968-5923b1c37a5f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.038799 Jul 14 18:18:33.752276 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 623/1289] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:18:34.728601 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-e70cf846-f4ac-4363-8073-795e4bd8ca67 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:18:34.729200 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-e70cf846-f4ac-4363-8073-795e4bd8ca67 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5ddfb4cb-657b-4b17-9272-6e8f69beef1d] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:18:34.736288 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e70cf846-f4ac-4363-8073-795e4bd8ca67 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:18:34.736737 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e70cf846-f4ac-4363-8073-795e4bd8ca67 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:18:34.737498 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e70cf846-f4ac-4363-8073-795e4bd8ca67 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:18:34.737934 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e70cf846-f4ac-4363-8073-795e4bd8ca67 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:18:34.867056 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-e70cf846-f4ac-4363-8073-795e4bd8ca67 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:18:34.875619 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-e70cf846-f4ac-4363-8073-795e4bd8ca67 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d" status: 200 len: 1265 microversion: 2.1 time: 0.150822 Jul 14 18:18:34.876271 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 667/1290] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:18:34 2022] GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:18:35.894558 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-5abbed85-3817-4364-a72f-14a92a66e4f4 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:18:35.895189 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-5abbed85-3817-4364-a72f-14a92a66e4f4 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5ddfb4cb-657b-4b17-9272-6e8f69beef1d] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:18:35.901453 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5abbed85-3817-4364-a72f-14a92a66e4f4 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:18:35.901910 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5abbed85-3817-4364-a72f-14a92a66e4f4 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:18:35.902677 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5abbed85-3817-4364-a72f-14a92a66e4f4 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:18:35.903121 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5abbed85-3817-4364-a72f-14a92a66e4f4 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:18:36.032172 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-5abbed85-3817-4364-a72f-14a92a66e4f4 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:18:36.039662 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-5abbed85-3817-4364-a72f-14a92a66e4f4 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d" status: 200 len: 1451 microversion: 2.1 time: 0.150451 Jul 14 18:18:36.040267 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 624/1291] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:18:35 2022] GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:18:36.056389 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-6209d9d8-172a-4d5e-b7d5-be75b2d0e41f tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:18:36.057007 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-6209d9d8-172a-4d5e-b7d5-be75b2d0e41f tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5ddfb4cb-657b-4b17-9272-6e8f69beef1d] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:18:36.064242 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6209d9d8-172a-4d5e-b7d5-be75b2d0e41f tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:18:36.064697 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6209d9d8-172a-4d5e-b7d5-be75b2d0e41f tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:18:36.065468 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6209d9d8-172a-4d5e-b7d5-be75b2d0e41f tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:18:36.065911 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-6209d9d8-172a-4d5e-b7d5-be75b2d0e41f tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:18:36.192271 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-6209d9d8-172a-4d5e-b7d5-be75b2d0e41f tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:18:36.199692 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-6209d9d8-172a-4d5e-b7d5-be75b2d0e41f tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d" status: 200 len: 1451 microversion: 2.1 time: 0.147162 Jul 14 18:18:36.200283 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 668/1292] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:18:36 2022] GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:18:38.047242 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-5bf0da9e-5d02-4a6c-8989-315b5353d43b req-f6034d1f-a181-459a-a400-4c929681161c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ddfb4cb-657b-4b17-9272-6e8f69beef1d", "tag": "effae01c-879e-45a0-a940-7f1c3027baf9"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:18:38.056379 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-5bf0da9e-5d02-4a6c-8989-315b5353d43b req-f6034d1f-a181-459a-a400-4c929681161c service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:18:38.056838 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-5bf0da9e-5d02-4a6c-8989-315b5353d43b req-f6034d1f-a181-459a-a400-4c929681161c service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:18:38.068271 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-5bf0da9e-5d02-4a6c-8989-315b5353d43b req-f6034d1f-a181-459a-a400-4c929681161c service nova] Creating event network-changed:effae01c-879e-45a0-a940-7f1c3027baf9 for instance 5ddfb4cb-657b-4b17-9272-6e8f69beef1d on hv-cinder-84989 Jul 14 18:18:38.073299 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-5bf0da9e-5d02-4a6c-8989-315b5353d43b req-f6034d1f-a181-459a-a400-4c929681161c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080692 Jul 14 18:18:38.073905 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 625/1293] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:18:46.693945 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 18:18:46.694521 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Thu Jul 14 18:18:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 18:18:58.611486 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 18:18:58.612050 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Thu Jul 14 18:18:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 18:20:23.685670 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 18:20:23.686323 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Thu Jul 14 18:20:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 18:20:27.970540 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d2e1a42f-17fa-4fd5-a9d7-01a4b9db0ab5] AMQP server on 10.222.0.64:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 14 18:20:27.971069 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_api:SELECT=22 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:20:27.971845 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG dbcounter [-] [129470] Writing DB stats nova_cell1:SELECT=46 {{(pid=129470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:20:27.972402 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-e7fa619b-4aae-4572-8366-e31d68411099 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:20:27.972953 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-e7fa619b-4aae-4572-8366-e31d68411099 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5ddfb4cb-657b-4b17-9272-6e8f69beef1d] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:20:27.976609 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:20:27.977262 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG dbcounter [-] [129471] Writing DB stats nova_cell1:SELECT=58 {{(pid=129471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:20:27.978145 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-e8d951ac-6560-4f96-80da-5e8ba23b53ea req-e32994ce-c776-49c9-b32b-34ba67a92870 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ddfb4cb-657b-4b17-9272-6e8f69beef1d", "tag": "effae01c-879e-45a0-a940-7f1c3027baf9"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:20:27.982764 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e7fa619b-4aae-4572-8366-e31d68411099 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:20:27.983220 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e7fa619b-4aae-4572-8366-e31d68411099 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:20:27.984046 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e7fa619b-4aae-4572-8366-e31d68411099 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:20:27.984709 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e7fa619b-4aae-4572-8366-e31d68411099 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:20:27.988869 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-e8d951ac-6560-4f96-80da-5e8ba23b53ea req-e32994ce-c776-49c9-b32b-34ba67a92870 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:20:27.989352 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-e8d951ac-6560-4f96-80da-5e8ba23b53ea req-e32994ce-c776-49c9-b32b-34ba67a92870 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:20:28.001366 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-e8d951ac-6560-4f96-80da-5e8ba23b53ea req-e32994ce-c776-49c9-b32b-34ba67a92870 service nova] Creating event network-changed:effae01c-879e-45a0-a940-7f1c3027baf9 for instance 5ddfb4cb-657b-4b17-9272-6e8f69beef1d on hv-cinder-84989 Jul 14 18:20:28.007581 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-e8d951ac-6560-4f96-80da-5e8ba23b53ea req-e32994ce-c776-49c9-b32b-34ba67a92870 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038662 Jul 14 18:20:28.008332 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 626/1294] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:20:28.014320 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-e7fa619b-4aae-4572-8366-e31d68411099 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5ddfb4cb-657b-4b17-9272-6e8f69beef1d] Going to try to terminate instance {{(pid=129471) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 18:20:28.081958 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e7fa619b-4aae-4572-8366-e31d68411099 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [de5399a0-0dbe-4ed8-a6c0-57bf532a8b00] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 18:20:28.863821 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 18:20:28.864028 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Thu Jul 14 18:20:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 18:20:29.089436 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO oslo.messaging._drivers.impl_rabbit [None req-e7fa619b-4aae-4572-8366-e31d68411099 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [de5399a0-0dbe-4ed8-a6c0-57bf532a8b00] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 39766. Jul 14 18:20:29.112593 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-e7fa619b-4aae-4572-8366-e31d68411099 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "DELETE /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d" status: 204 len: 0 microversion: 2.1 time: 1.146039 Jul 14 18:20:29.113218 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 669/1295] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Jul 14 18:20:27 2022] DELETE /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d => generated 0 bytes in 1149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 18:20:29.123589 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-3c61f476-7c71-4209-a95f-b6641e934548 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:20:29.124368 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-3c61f476-7c71-4209-a95f-b6641e934548 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5ddfb4cb-657b-4b17-9272-6e8f69beef1d] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:20:29.131854 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3c61f476-7c71-4209-a95f-b6641e934548 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:20:29.132370 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3c61f476-7c71-4209-a95f-b6641e934548 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:20:29.133140 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3c61f476-7c71-4209-a95f-b6641e934548 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:20:29.134012 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-3c61f476-7c71-4209-a95f-b6641e934548 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:20:29.140501 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO oslo.messaging._drivers.impl_rabbit [-] [d2e1a42f-17fa-4fd5-a9d7-01a4b9db0ab5] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 39770. Jul 14 18:20:29.267235 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-3c61f476-7c71-4209-a95f-b6641e934548 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:20:29.274698 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-3c61f476-7c71-4209-a95f-b6641e934548 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d" status: 200 len: 1457 microversion: 2.1 time: 0.156960 Jul 14 18:20:29.275258 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 627/1296] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:20:29 2022] GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d => generated 1457 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:20:30.293379 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-e0b6ddf9-be31-483c-bad2-36f5120f7bde tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:20:30.294098 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-e0b6ddf9-be31-483c-bad2-36f5120f7bde tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5ddfb4cb-657b-4b17-9272-6e8f69beef1d] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:20:30.300666 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e0b6ddf9-be31-483c-bad2-36f5120f7bde tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:20:30.301124 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e0b6ddf9-be31-483c-bad2-36f5120f7bde tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:20:30.301896 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e0b6ddf9-be31-483c-bad2-36f5120f7bde tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:20:30.302366 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e0b6ddf9-be31-483c-bad2-36f5120f7bde tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:20:30.433821 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-e0b6ddf9-be31-483c-bad2-36f5120f7bde tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:20:30.441331 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-e0b6ddf9-be31-483c-bad2-36f5120f7bde tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d" status: 200 len: 1457 microversion: 2.1 time: 0.152744 Jul 14 18:20:30.441900 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 670/1297] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:20:30 2022] GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d => generated 1457 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:20:31.426580 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-dc43ed91-d689-4023-93be-cfa7f5d7166b req-c696ce58-93d2-4681-a901-a3391820e39e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ddfb4cb-657b-4b17-9272-6e8f69beef1d", "name": "network-vif-deleted", "tag": "effae01c-879e-45a0-a940-7f1c3027baf9"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:20:31.436321 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-dc43ed91-d689-4023-93be-cfa7f5d7166b req-c696ce58-93d2-4681-a901-a3391820e39e service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:20:31.436763 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-dc43ed91-d689-4023-93be-cfa7f5d7166b req-c696ce58-93d2-4681-a901-a3391820e39e service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:20:31.447857 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-dc43ed91-d689-4023-93be-cfa7f5d7166b req-c696ce58-93d2-4681-a901-a3391820e39e service nova] Creating event network-vif-deleted:effae01c-879e-45a0-a940-7f1c3027baf9 for instance 5ddfb4cb-657b-4b17-9272-6e8f69beef1d on hv-cinder-84989 Jul 14 18:20:31.453337 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-dc43ed91-d689-4023-93be-cfa7f5d7166b req-c696ce58-93d2-4681-a901-a3391820e39e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030248 Jul 14 18:20:31.454212 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 628/1298] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:20:31.458789 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-d21babb4-fbc5-4402-b149-58f9ffdb4a9e tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:20:31.459447 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-d21babb4-fbc5-4402-b149-58f9ffdb4a9e tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5ddfb4cb-657b-4b17-9272-6e8f69beef1d] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:20:31.465642 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d21babb4-fbc5-4402-b149-58f9ffdb4a9e tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:20:31.466099 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d21babb4-fbc5-4402-b149-58f9ffdb4a9e tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:20:31.466892 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d21babb4-fbc5-4402-b149-58f9ffdb4a9e tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:20:31.467336 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d21babb4-fbc5-4402-b149-58f9ffdb4a9e tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:20:31.529923 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-d21babb4-fbc5-4402-b149-58f9ffdb4a9e tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:20:31.537340 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-d21babb4-fbc5-4402-b149-58f9ffdb4a9e tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d" status: 200 len: 1225 microversion: 2.1 time: 0.082828 Jul 14 18:20:31.537897 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 671/1299] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:20:31 2022] GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:20:32.555159 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-764b064a-6b60-418d-a8fb-546b88c78669 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:20:32.555936 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-764b064a-6b60-418d-a8fb-546b88c78669 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5ddfb4cb-657b-4b17-9272-6e8f69beef1d] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:20:32.563459 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-764b064a-6b60-418d-a8fb-546b88c78669 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:20:32.563916 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-764b064a-6b60-418d-a8fb-546b88c78669 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:20:32.564715 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-764b064a-6b60-418d-a8fb-546b88c78669 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:20:32.565162 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-764b064a-6b60-418d-a8fb-546b88c78669 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:20:32.578764 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.wsgi [None req-764b064a-6b60-418d-a8fb-546b88c78669 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] HTTP exception thrown: Instance 5ddfb4cb-657b-4b17-9272-6e8f69beef1d could not be found. Jul 14 18:20:32.580399 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-764b064a-6b60-418d-a8fb-546b88c78669 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Request method failure captured: Jul 14 18:20:32.580399 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: request: GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d HTTP/1.1 Jul 14 18:20:32.580399 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept: application/json Jul 14 18:20:32.580399 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept-Encoding: identity Jul 14 18:20:32.580399 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Connection: close Jul 14 18:20:32.580399 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Length: 0 Jul 14 18:20:32.580399 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Type: application/json Jul 14 18:20:32.580399 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Host: 10.222.0.64 Jul 14 18:20:32.580399 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Openstack-System-Scope: None Jul 14 18:20:32.580399 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: User-Agent: python-urllib3/1.26.9 Jul 14 18:20:32.580399 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Auth-Token: gAAAAABi0Fydm_x9t_czjuOYcNiGD1oyYGG9f15NR9hKGssK_MbkkU7q2VkLd5an5hh9XMZatSPUPpRdHtBu-TZALYiIpfoGTNiaq4_YakfNT39VMb75su4fovx5O-c1Ae3zQ2VNICCu6jXQKImXh45XzksJYdJz8MWzbA70QsMRKZaDxquRP1k Jul 14 18:20:32.580399 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Id: None Jul 14 18:20:32.580399 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Name: None Jul 14 18:20:32.580399 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Identity-Status: Confirmed Jul 14 18:20:32.580399 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Is-Admin-Project: True Jul 14 18:20:32.580399 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Id: default Jul 14 18:20:32.580399 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Name: Default Jul 14 18:20:32.580399 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Id: 3a189153b8f44520a5bac2c4bcedc013 Jul 14 18:20:32.580399 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Name: tempest-TestVolumeBootPattern-11060473 Jul 14 18:20:32.580399 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Role: reader,member Jul 14 18:20:32.580399 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Roles: reader,member Jul 14 18:20:32.582281 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3a189153b8f44520a5bac2c4bcedc013"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3a189153b8f44520a5bac2c4bcedc013"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3a189153b8f44520a5bac2c4bcedc013"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3a189153b8f44520a5bac2c4bcedc013", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:20:32.582281 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant: tempest-TestVolumeBootPattern-11060473 Jul 14 18:20:32.582281 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Id: 3a189153b8f44520a5bac2c4bcedc013 Jul 14 18:20:32.582281 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Name: tempest-TestVolumeBootPattern-11060473 Jul 14 18:20:32.582281 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User: tempest-TestVolumeBootPattern-11060473-project Jul 14 18:20:32.582281 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Id: default Jul 14 18:20:32.582281 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Name: Default Jul 14 18:20:32.582281 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Id: 15d9d47d160b4595a16bf23eaa509a08 Jul 14 18:20:32.582281 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Name: tempest-TestVolumeBootPattern-11060473-project Jul 14 18:20:32.582281 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: method: > Jul 14 18:20:32.582281 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: exception: Instance 5ddfb4cb-657b-4b17-9272-6e8f69beef1d could not be found. Jul 14 18:20:32.582281 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: action_args: {'id': '5ddfb4cb-657b-4b17-9272-6e8f69beef1d'} Jul 14 18:20:32.586288 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:20:32.586288 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:20:32.586288 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 18:20:32.586288 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 18:20:32.586288 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 18:20:32.586288 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 18:20:32.586288 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 18:20:32.586288 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 18:20:32.586288 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 18:20:32.586288 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 18:20:32.586288 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ddfb4cb-657b-4b17-9272-6e8f69beef1d could not be found. Jul 14 18:20:32.586288 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:20:32.586288 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:20:32.586288 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:20:32.586288 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:20:32.586288 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:20:32.586288 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:20:32.586288 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:20:32.586288 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:20:32.586288 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:20:32.588309 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:20:32.588309 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 18:20:32.588309 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 18:20:32.588309 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 18:20:32.588309 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 18:20:32.588309 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 18:20:32.588309 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 18:20:32.588309 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ddfb4cb-657b-4b17-9272-6e8f69beef1d could not be found. Jul 14 18:20:32.588309 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:20:32.588309 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:20:32.588309 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:20:32.588309 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:20:32.588309 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:20:32.588309 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:20:32.588309 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 18:20:32.588309 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 18:20:32.588309 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ddfb4cb-657b-4b17-9272-6e8f69beef1d could not be found. Jul 14 18:20:32.588309 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:20:32.590380 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-764b064a-6b60-418d-a8fb-546b88c78669 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Returning 404 to user: Instance 5ddfb4cb-657b-4b17-9272-6e8f69beef1d could not be found. {{(pid=129470) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:20:32.590380 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-764b064a-6b60-418d-a8fb-546b88c78669 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d" status: 404 len: 111 microversion: 2.1 time: 0.030862 Jul 14 18:20:32.590380 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 629/1300] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:20:32 2022] GET /compute/v2.1/servers/5ddfb4cb-657b-4b17-9272-6e8f69beef1d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 18:20:35.610941 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-e43436b7-81ce-4ce8-8424-4e3dcd7d9ed5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:20:35.611479 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-e43436b7-81ce-4ce8-8424-4e3dcd7d9ed5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 86d54bfb-adec-469c-bb9e-f81824d88c2d] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:20:35.613451 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-40afb777-a962-4395-8bf7-865b79ef77eb req-a03a3ddd-c364-4d7a-9730-470eaf89b992 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86d54bfb-adec-469c-bb9e-f81824d88c2d", "tag": "57218723-5ddf-4983-ab0c-3c02bbf3075b"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:20:35.618111 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e43436b7-81ce-4ce8-8424-4e3dcd7d9ed5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:20:35.618562 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e43436b7-81ce-4ce8-8424-4e3dcd7d9ed5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:20:35.619333 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e43436b7-81ce-4ce8-8424-4e3dcd7d9ed5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:20:35.619770 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-e43436b7-81ce-4ce8-8424-4e3dcd7d9ed5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:20:35.623112 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-40afb777-a962-4395-8bf7-865b79ef77eb req-a03a3ddd-c364-4d7a-9730-470eaf89b992 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:20:35.623622 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-40afb777-a962-4395-8bf7-865b79ef77eb req-a03a3ddd-c364-4d7a-9730-470eaf89b992 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:20:35.634690 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-40afb777-a962-4395-8bf7-865b79ef77eb req-a03a3ddd-c364-4d7a-9730-470eaf89b992 service nova] Creating event network-changed:57218723-5ddf-4983-ab0c-3c02bbf3075b for instance 86d54bfb-adec-469c-bb9e-f81824d88c2d on hv-cinder-84989 Jul 14 18:20:35.640698 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-40afb777-a962-4395-8bf7-865b79ef77eb req-a03a3ddd-c364-4d7a-9730-470eaf89b992 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031040 Jul 14 18:20:35.641475 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 630/1301] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 18:20:35.646403 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-e43436b7-81ce-4ce8-8424-4e3dcd7d9ed5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 86d54bfb-adec-469c-bb9e-f81824d88c2d] Going to try to terminate instance {{(pid=129471) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 18:20:35.726791 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-e43436b7-81ce-4ce8-8424-4e3dcd7d9ed5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "DELETE /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d" status: 204 len: 0 microversion: 2.1 time: 0.119633 Jul 14 18:20:35.727351 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 672/1302] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Jul 14 18:20:35 2022] DELETE /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 18:20:35.736596 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-5673ef57-1a2e-4267-b74e-86f69cbdb877 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:20:35.737429 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-5673ef57-1a2e-4267-b74e-86f69cbdb877 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 86d54bfb-adec-469c-bb9e-f81824d88c2d] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:20:35.743748 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5673ef57-1a2e-4267-b74e-86f69cbdb877 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:20:35.744496 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5673ef57-1a2e-4267-b74e-86f69cbdb877 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:20:35.745270 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5673ef57-1a2e-4267-b74e-86f69cbdb877 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:20:35.746234 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-5673ef57-1a2e-4267-b74e-86f69cbdb877 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:20:35.883340 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.policy [None req-5673ef57-1a2e-4267-b74e-86f69cbdb877 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129470) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:20:35.891690 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-5673ef57-1a2e-4267-b74e-86f69cbdb877 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d" status: 200 len: 1577 microversion: 2.1 time: 0.159718 Jul 14 18:20:35.892292 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 631/1303] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:20:35 2022] GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:20:36.909644 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-d7d24394-2ffb-4ffc-b5d5-b227f96d6abe tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:20:36.910350 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-d7d24394-2ffb-4ffc-b5d5-b227f96d6abe tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 86d54bfb-adec-469c-bb9e-f81824d88c2d] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:20:36.916783 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d7d24394-2ffb-4ffc-b5d5-b227f96d6abe tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:20:36.917239 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d7d24394-2ffb-4ffc-b5d5-b227f96d6abe tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:20:36.918017 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d7d24394-2ffb-4ffc-b5d5-b227f96d6abe tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:20:36.918462 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d7d24394-2ffb-4ffc-b5d5-b227f96d6abe tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:20:37.050278 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-d7d24394-2ffb-4ffc-b5d5-b227f96d6abe tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:20:37.057707 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-d7d24394-2ffb-4ffc-b5d5-b227f96d6abe tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d" status: 200 len: 1577 microversion: 2.1 time: 0.152309 Jul 14 18:20:37.058982 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 673/1304] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:20:36 2022] GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:20:38.026180 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [req-25a6a9ae-52cd-471b-8373-4b9f0e6111b7 req-9ae8279a-22a9-4cbb-abc4-84158b2940b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86d54bfb-adec-469c-bb9e-f81824d88c2d", "name": "network-vif-deleted", "tag": "57218723-5ddf-4983-ab0c-3c02bbf3075b"}]} {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 18:20:38.035886 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-25a6a9ae-52cd-471b-8373-4b9f0e6111b7 req-9ae8279a-22a9-4cbb-abc4-84158b2940b0 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:20:38.036364 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [req-25a6a9ae-52cd-471b-8373-4b9f0e6111b7 req-9ae8279a-22a9-4cbb-abc4-84158b2940b0 service nova] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:20:38.048910 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.compute.server_external_events [req-25a6a9ae-52cd-471b-8373-4b9f0e6111b7 req-9ae8279a-22a9-4cbb-abc4-84158b2940b0 service nova] Creating event network-vif-deleted:57218723-5ddf-4983-ab0c-3c02bbf3075b for instance 86d54bfb-adec-469c-bb9e-f81824d88c2d on hv-cinder-84989 Jul 14 18:20:38.054131 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [req-25a6a9ae-52cd-471b-8373-4b9f0e6111b7 req-9ae8279a-22a9-4cbb-abc4-84158b2940b0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031348 Jul 14 18:20:38.054849 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 632/1305] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Jul 14 18:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:20:38.074429 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-52e2a76a-8a71-4044-89f6-1ee201dda2f6 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:20:38.075036 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-52e2a76a-8a71-4044-89f6-1ee201dda2f6 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 86d54bfb-adec-469c-bb9e-f81824d88c2d] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:20:38.081898 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-52e2a76a-8a71-4044-89f6-1ee201dda2f6 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:20:38.082341 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-52e2a76a-8a71-4044-89f6-1ee201dda2f6 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:20:38.083102 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-52e2a76a-8a71-4044-89f6-1ee201dda2f6 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:20:38.083531 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-52e2a76a-8a71-4044-89f6-1ee201dda2f6 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:20:38.146469 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.policy [None req-52e2a76a-8a71-4044-89f6-1ee201dda2f6 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d9d47d160b4595a16bf23eaa509a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a189153b8f44520a5bac2c4bcedc013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129471) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 18:20:38.154412 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-52e2a76a-8a71-4044-89f6-1ee201dda2f6 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d" status: 200 len: 1225 microversion: 2.1 time: 0.083840 Jul 14 18:20:38.154970 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 674/1306] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:20:38 2022] GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 18:20:39.171722 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-d28c52c9-54e4-4430-9066-cbea1d5f0ce5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:20:39.172449 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-d28c52c9-54e4-4430-9066-cbea1d5f0ce5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 86d54bfb-adec-469c-bb9e-f81824d88c2d] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:20:39.179184 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d28c52c9-54e4-4430-9066-cbea1d5f0ce5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:20:39.179642 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d28c52c9-54e4-4430-9066-cbea1d5f0ce5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:20:39.180438 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d28c52c9-54e4-4430-9066-cbea1d5f0ce5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:20:39.180876 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-d28c52c9-54e4-4430-9066-cbea1d5f0ce5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:20:39.194423 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.wsgi [None req-d28c52c9-54e4-4430-9066-cbea1d5f0ce5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] HTTP exception thrown: Instance 86d54bfb-adec-469c-bb9e-f81824d88c2d could not be found. Jul 14 18:20:39.196047 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-d28c52c9-54e4-4430-9066-cbea1d5f0ce5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Request method failure captured: Jul 14 18:20:39.196047 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: request: GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d HTTP/1.1 Jul 14 18:20:39.196047 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept: application/json Jul 14 18:20:39.196047 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept-Encoding: identity Jul 14 18:20:39.196047 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Connection: close Jul 14 18:20:39.196047 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Length: 0 Jul 14 18:20:39.196047 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Type: application/json Jul 14 18:20:39.196047 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Host: 10.222.0.64 Jul 14 18:20:39.196047 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Openstack-System-Scope: None Jul 14 18:20:39.196047 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: User-Agent: python-urllib3/1.26.9 Jul 14 18:20:39.196047 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Auth-Token: gAAAAABi0Fydm_x9t_czjuOYcNiGD1oyYGG9f15NR9hKGssK_MbkkU7q2VkLd5an5hh9XMZatSPUPpRdHtBu-TZALYiIpfoGTNiaq4_YakfNT39VMb75su4fovx5O-c1Ae3zQ2VNICCu6jXQKImXh45XzksJYdJz8MWzbA70QsMRKZaDxquRP1k Jul 14 18:20:39.196047 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Id: None Jul 14 18:20:39.196047 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Name: None Jul 14 18:20:39.196047 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Identity-Status: Confirmed Jul 14 18:20:39.196047 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Is-Admin-Project: True Jul 14 18:20:39.196047 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Id: default Jul 14 18:20:39.196047 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Name: Default Jul 14 18:20:39.196047 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Id: 3a189153b8f44520a5bac2c4bcedc013 Jul 14 18:20:39.196047 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Name: tempest-TestVolumeBootPattern-11060473 Jul 14 18:20:39.196047 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Role: reader,member Jul 14 18:20:39.196047 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Roles: reader,member Jul 14 18:20:39.197945 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3a189153b8f44520a5bac2c4bcedc013"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3a189153b8f44520a5bac2c4bcedc013"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3a189153b8f44520a5bac2c4bcedc013"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3a189153b8f44520a5bac2c4bcedc013", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:20:39.197945 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant: tempest-TestVolumeBootPattern-11060473 Jul 14 18:20:39.197945 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Id: 3a189153b8f44520a5bac2c4bcedc013 Jul 14 18:20:39.197945 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Name: tempest-TestVolumeBootPattern-11060473 Jul 14 18:20:39.197945 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User: tempest-TestVolumeBootPattern-11060473-project Jul 14 18:20:39.197945 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Id: default Jul 14 18:20:39.197945 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Name: Default Jul 14 18:20:39.197945 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Id: 15d9d47d160b4595a16bf23eaa509a08 Jul 14 18:20:39.197945 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Name: tempest-TestVolumeBootPattern-11060473-project Jul 14 18:20:39.197945 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: method: > Jul 14 18:20:39.197945 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: exception: Instance 86d54bfb-adec-469c-bb9e-f81824d88c2d could not be found. Jul 14 18:20:39.197945 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: action_args: {'id': '86d54bfb-adec-469c-bb9e-f81824d88c2d'} Jul 14 18:20:39.199115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:20:39.199115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:20:39.199115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 18:20:39.199115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 18:20:39.199115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 18:20:39.199115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 18:20:39.199115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 18:20:39.199115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 18:20:39.199115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 18:20:39.199115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 18:20:39.199115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86d54bfb-adec-469c-bb9e-f81824d88c2d could not be found. Jul 14 18:20:39.199115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:20:39.199115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:20:39.199115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:20:39.199115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:20:39.199115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:20:39.199115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:20:39.199115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:20:39.199115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:20:39.199115 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:20:39.200928 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:20:39.200928 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 18:20:39.200928 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 18:20:39.200928 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 18:20:39.200928 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 18:20:39.200928 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 18:20:39.200928 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 18:20:39.200928 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86d54bfb-adec-469c-bb9e-f81824d88c2d could not be found. Jul 14 18:20:39.200928 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:20:39.200928 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:20:39.200928 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:20:39.200928 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:20:39.200928 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:20:39.200928 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:20:39.200928 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 18:20:39.200928 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 18:20:39.200928 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86d54bfb-adec-469c-bb9e-f81824d88c2d could not be found. Jul 14 18:20:39.200928 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:20:39.202512 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-d28c52c9-54e4-4430-9066-cbea1d5f0ce5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Returning 404 to user: Instance 86d54bfb-adec-469c-bb9e-f81824d88c2d could not be found. {{(pid=129470) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:20:39.202512 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-d28c52c9-54e4-4430-9066-cbea1d5f0ce5 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d" status: 404 len: 111 microversion: 2.1 time: 0.030465 Jul 14 18:20:39.202512 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 633/1307] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:20:39 2022] GET /compute/v2.1/servers/86d54bfb-adec-469c-bb9e-f81824d88c2d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 18:20:39.862262 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-d0a968d2-45cb-480b-8557-1a2ac8c01a5d tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:20:39.862793 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.compute.api [None req-d0a968d2-45cb-480b-8557-1a2ac8c01a5d tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3] Fetching instance by UUID {{(pid=129471) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:20:39.871701 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d0a968d2-45cb-480b-8557-1a2ac8c01a5d tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:20:39.872203 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d0a968d2-45cb-480b-8557-1a2ac8c01a5d tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:20:39.872982 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d0a968d2-45cb-480b-8557-1a2ac8c01a5d tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:20:39.873424 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG oslo_concurrency.lockutils [None req-d0a968d2-45cb-480b-8557-1a2ac8c01a5d tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:20:39.889436 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.wsgi [None req-d0a968d2-45cb-480b-8557-1a2ac8c01a5d tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] HTTP exception thrown: Instance 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 could not be found. Jul 14 18:20:39.891098 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-d0a968d2-45cb-480b-8557-1a2ac8c01a5d tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Request method failure captured: Jul 14 18:20:39.891098 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: request: DELETE /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 HTTP/1.1 Jul 14 18:20:39.891098 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept: application/json Jul 14 18:20:39.891098 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Accept-Encoding: identity Jul 14 18:20:39.891098 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Connection: close Jul 14 18:20:39.891098 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Length: 0 Jul 14 18:20:39.891098 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Content-Type: application/json Jul 14 18:20:39.891098 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Host: 10.222.0.64 Jul 14 18:20:39.891098 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Openstack-System-Scope: None Jul 14 18:20:39.891098 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: User-Agent: python-urllib3/1.26.9 Jul 14 18:20:39.891098 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Auth-Token: gAAAAABi0Fydm_x9t_czjuOYcNiGD1oyYGG9f15NR9hKGssK_MbkkU7q2VkLd5an5hh9XMZatSPUPpRdHtBu-TZALYiIpfoGTNiaq4_YakfNT39VMb75su4fovx5O-c1Ae3zQ2VNICCu6jXQKImXh45XzksJYdJz8MWzbA70QsMRKZaDxquRP1k Jul 14 18:20:39.891098 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Id: None Jul 14 18:20:39.891098 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Domain-Name: None Jul 14 18:20:39.891098 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Identity-Status: Confirmed Jul 14 18:20:39.891098 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Is-Admin-Project: True Jul 14 18:20:39.891098 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Id: default Jul 14 18:20:39.891098 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Domain-Name: Default Jul 14 18:20:39.891098 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Id: 3a189153b8f44520a5bac2c4bcedc013 Jul 14 18:20:39.891098 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Project-Name: tempest-TestVolumeBootPattern-11060473 Jul 14 18:20:39.891098 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Role: reader,member Jul 14 18:20:39.891098 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Roles: reader,member Jul 14 18:20:39.892829 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3a189153b8f44520a5bac2c4bcedc013"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3a189153b8f44520a5bac2c4bcedc013"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3a189153b8f44520a5bac2c4bcedc013"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3a189153b8f44520a5bac2c4bcedc013", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:20:39.892829 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant: tempest-TestVolumeBootPattern-11060473 Jul 14 18:20:39.892829 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Id: 3a189153b8f44520a5bac2c4bcedc013 Jul 14 18:20:39.892829 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-Tenant-Name: tempest-TestVolumeBootPattern-11060473 Jul 14 18:20:39.892829 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User: tempest-TestVolumeBootPattern-11060473-project Jul 14 18:20:39.892829 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Id: default Jul 14 18:20:39.892829 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Domain-Name: Default Jul 14 18:20:39.892829 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Id: 15d9d47d160b4595a16bf23eaa509a08 Jul 14 18:20:39.892829 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: X-User-Name: tempest-TestVolumeBootPattern-11060473-project Jul 14 18:20:39.892829 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: method: > Jul 14 18:20:39.892829 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: exception: Instance 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 could not be found. Jul 14 18:20:39.892829 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: action_args: {'id': '5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3'} Jul 14 18:20:39.893914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:20:39.893914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:20:39.893914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 18:20:39.893914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 18:20:39.893914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 18:20:39.893914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 18:20:39.893914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 18:20:39.893914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 18:20:39.893914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 18:20:39.893914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 18:20:39.893914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 could not be found. Jul 14 18:20:39.893914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:20:39.893914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:20:39.893914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:20:39.893914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:20:39.893914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:20:39.893914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:20:39.893914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:20:39.893914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:20:39.893914 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:20:39.895574 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:20:39.895574 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 18:20:39.895574 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 18:20:39.895574 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 18:20:39.895574 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 18:20:39.895574 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 18:20:39.895574 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 18:20:39.895574 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 18:20:39.895574 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 18:20:39.895574 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 could not be found. Jul 14 18:20:39.895574 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:20:39.895574 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:20:39.895574 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:20:39.895574 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:20:39.895574 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:20:39.895574 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:20:39.895574 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 18:20:39.895574 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 18:20:39.895574 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 could not be found. Jul 14 18:20:39.895574 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: ERROR nova.api.openstack.wsgi Jul 14 18:20:39.897305 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-d0a968d2-45cb-480b-8557-1a2ac8c01a5d tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Returning 404 to user: Instance 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 could not be found. {{(pid=129471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:20:39.897305 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-d0a968d2-45cb-480b-8557-1a2ac8c01a5d tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "DELETE /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3" status: 404 len: 111 microversion: 2.1 time: 0.034245 Jul 14 18:20:39.897305 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 675/1308] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Jul 14 18:20:39 2022] DELETE /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 18:20:39.901234 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-48f332ff-69b6-440d-b6a4-4d2c076f09f6 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '>' {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:20:39.902662 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.compute.api [None req-48f332ff-69b6-440d-b6a4-4d2c076f09f6 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] [instance: 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3] Fetching instance by UUID {{(pid=129470) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 18:20:39.908624 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-48f332ff-69b6-440d-b6a4-4d2c076f09f6 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:20:39.909076 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-48f332ff-69b6-440d-b6a4-4d2c076f09f6 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:20:39.910053 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-48f332ff-69b6-440d-b6a4-4d2c076f09f6 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:20:39.910500 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG oslo_concurrency.lockutils [None req-48f332ff-69b6-440d-b6a4-4d2c076f09f6 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Lock "4eefd466-1950-4d22-9e5e-a86218979b69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:20:39.923948 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.wsgi [None req-48f332ff-69b6-440d-b6a4-4d2c076f09f6 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] HTTP exception thrown: Instance 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 could not be found. Jul 14 18:20:39.925475 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-48f332ff-69b6-440d-b6a4-4d2c076f09f6 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Request method failure captured: Jul 14 18:20:39.925475 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: request: GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 HTTP/1.1 Jul 14 18:20:39.925475 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept: application/json Jul 14 18:20:39.925475 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Accept-Encoding: identity Jul 14 18:20:39.925475 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Connection: close Jul 14 18:20:39.925475 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Length: 0 Jul 14 18:20:39.925475 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Content-Type: application/json Jul 14 18:20:39.925475 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Host: 10.222.0.64 Jul 14 18:20:39.925475 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Openstack-System-Scope: None Jul 14 18:20:39.925475 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: User-Agent: python-urllib3/1.26.9 Jul 14 18:20:39.925475 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Auth-Token: gAAAAABi0Fydm_x9t_czjuOYcNiGD1oyYGG9f15NR9hKGssK_MbkkU7q2VkLd5an5hh9XMZatSPUPpRdHtBu-TZALYiIpfoGTNiaq4_YakfNT39VMb75su4fovx5O-c1Ae3zQ2VNICCu6jXQKImXh45XzksJYdJz8MWzbA70QsMRKZaDxquRP1k Jul 14 18:20:39.925475 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Id: None Jul 14 18:20:39.925475 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Domain-Name: None Jul 14 18:20:39.925475 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Identity-Status: Confirmed Jul 14 18:20:39.925475 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Is-Admin-Project: True Jul 14 18:20:39.925475 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Id: default Jul 14 18:20:39.925475 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Domain-Name: Default Jul 14 18:20:39.925475 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Id: 3a189153b8f44520a5bac2c4bcedc013 Jul 14 18:20:39.925475 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Project-Name: tempest-TestVolumeBootPattern-11060473 Jul 14 18:20:39.925475 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Role: reader,member Jul 14 18:20:39.925475 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Roles: reader,member Jul 14 18:20:39.927298 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3a189153b8f44520a5bac2c4bcedc013"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3a189153b8f44520a5bac2c4bcedc013"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3a189153b8f44520a5bac2c4bcedc013"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3a189153b8f44520a5bac2c4bcedc013", "adminURL": "http://10.222.0.64:8080"}]}] Jul 14 18:20:39.927298 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant: tempest-TestVolumeBootPattern-11060473 Jul 14 18:20:39.927298 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Id: 3a189153b8f44520a5bac2c4bcedc013 Jul 14 18:20:39.927298 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-Tenant-Name: tempest-TestVolumeBootPattern-11060473 Jul 14 18:20:39.927298 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User: tempest-TestVolumeBootPattern-11060473-project Jul 14 18:20:39.927298 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Id: default Jul 14 18:20:39.927298 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Domain-Name: Default Jul 14 18:20:39.927298 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Id: 15d9d47d160b4595a16bf23eaa509a08 Jul 14 18:20:39.927298 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: X-User-Name: tempest-TestVolumeBootPattern-11060473-project Jul 14 18:20:39.927298 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: method: > Jul 14 18:20:39.927298 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: exception: Instance 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 could not be found. Jul 14 18:20:39.927298 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: action_args: {'id': '5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3'} Jul 14 18:20:39.928375 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: {{(pid=129470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 18:20:39.928375 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:20:39.928375 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 18:20:39.928375 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 18:20:39.928375 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 18:20:39.928375 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 18:20:39.928375 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 18:20:39.928375 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 18:20:39.928375 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 18:20:39.928375 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 18:20:39.928375 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 could not be found. Jul 14 18:20:39.928375 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:20:39.928375 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:20:39.928375 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:20:39.928375 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:20:39.928375 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:20:39.928375 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:20:39.928375 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 18:20:39.928375 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 18:20:39.928375 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 18:20:39.930073 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 18:20:39.930073 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 18:20:39.930073 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 18:20:39.930073 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 18:20:39.930073 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 18:20:39.930073 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 18:20:39.930073 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 18:20:39.930073 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 could not be found. Jul 14 18:20:39.930073 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:20:39.930073 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 18:20:39.930073 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:20:39.930073 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 18:20:39.930073 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 18:20:39.930073 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 18:20:39.930073 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 18:20:39.930073 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 18:20:39.930073 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 could not be found. Jul 14 18:20:39.930073 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: ERROR nova.api.openstack.wsgi Jul 14 18:20:39.931642 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: DEBUG nova.api.openstack.wsgi [None req-48f332ff-69b6-440d-b6a4-4d2c076f09f6 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Returning 404 to user: Instance 5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 could not be found. {{(pid=129470) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 18:20:39.931642 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO nova.api.openstack.requestlog [None req-48f332ff-69b6-440d-b6a4-4d2c076f09f6 tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3" status: 404 len: 111 microversion: 2.1 time: 0.029578 Jul 14 18:20:39.931642 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: [pid: 129470|app: 0|req: 634/1309] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Jul 14 18:20:39 2022] GET /compute/v2.1/servers/5fb0c7c7-dd7e-416a-a34d-7f954a91e8b3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 18:20:41.215767 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: DEBUG nova.api.openstack.wsgi [None req-d7fab37e-6284-467a-ac07-a497788a23ef tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] Calling method '.version_select at 0x7f137b4cf9d0>' {{(pid=129471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:20:41.237965 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO nova.api.openstack.requestlog [None req-d7fab37e-6284-467a-ac07-a497788a23ef tempest-TestVolumeBootPattern-11060473 tempest-TestVolumeBootPattern-11060473-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1877107686" status: 202 len: 0 microversion: 2.1 time: 0.026532 Jul 14 18:20:41.238552 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: [pid: 129471|app: 0|req: 676/1310] 10.222.0.64 () {58 vars in 1262 bytes} [Thu Jul 14 18:20:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1877107686 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 18:22:18.620248 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 18:22:18.620865 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Thu Jul 14 18:22:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 18:23:43.693692 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 18:23:43.694289 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Thu Jul 14 18:23:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 18:23:46.703784 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 18:23:46.704416 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Thu Jul 14 18:23:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 18:23:48.872568 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 18:23:48.873148 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Thu Jul 14 18:23:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 18:25:38.628451 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 18:25:38.629157 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Thu Jul 14 18:25:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 18:25:41.084378 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 18:25:41.085225 dv-cinder-849890-1-iscsi devstack@n-api.service[129470]: Thu Jul 14 18:25:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 18:26:04.617826 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 18:26:04.618949 dv-cinder-849890-1-iscsi devstack@n-api.service[129471]: Thu Jul 14 18:26:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!